-- Logs begin at Mon 2022-10-03 14:11:28 UTC, end at Mon 2022-10-03 15:16:11 UTC. -- Oct 03 14:43:18.805038 dv-cinder-859877-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 03 14:43:18.814262 dv-cinder-859877-2-iscsi devstack@n-api.service[111841]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 03 14:43:18.816232 dv-cinder-859877-2-iscsi devstack@n-api.service[111841]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 3 14:43:18 2022] *** Oct 03 14:43:18.816232 dv-cinder-859877-2-iscsi devstack@n-api.service[111841]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 03 14:43:18.816232 dv-cinder-859877-2-iscsi devstack@n-api.service[111841]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 03 14:43:18.816232 dv-cinder-859877-2-iscsi devstack@n-api.service[111841]: nodename: dv-cinder-859877-2-iscsi Oct 03 14:43:18.816232 dv-cinder-859877-2-iscsi devstack@n-api.service[111841]: machine: x86_64 Oct 03 14:43:18.816232 dv-cinder-859877-2-iscsi devstack@n-api.service[111841]: clock source: unix Oct 03 14:43:18.816232 dv-cinder-859877-2-iscsi devstack@n-api.service[111841]: pcre jit disabled Oct 03 14:43:18.816232 dv-cinder-859877-2-iscsi devstack@n-api.service[111841]: detected number of CPU cores: 4 Oct 03 14:43:18.816232 dv-cinder-859877-2-iscsi devstack@n-api.service[111841]: current working directory: / Oct 03 14:43:18.816232 dv-cinder-859877-2-iscsi devstack@n-api.service[111841]: detected binary path: /usr/bin/uwsgi-core Oct 03 14:43:18.816827 dv-cinder-859877-2-iscsi devstack@n-api.service[111841]: your processes number limit is 47680 Oct 03 14:43:18.816827 dv-cinder-859877-2-iscsi devstack@n-api.service[111841]: your memory page size is 4096 bytes Oct 03 14:43:18.816827 dv-cinder-859877-2-iscsi devstack@n-api.service[111841]: detected max file descriptor number: 2048 Oct 03 14:43:18.816827 dv-cinder-859877-2-iscsi devstack@n-api.service[111841]: lock engine: pthread robust mutexes Oct 03 14:43:18.816827 dv-cinder-859877-2-iscsi devstack@n-api.service[111841]: thunder lock: enabled Oct 03 14:43:18.816827 dv-cinder-859877-2-iscsi devstack@n-api.service[111841]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 03 14:43:18.816827 dv-cinder-859877-2-iscsi devstack@n-api.service[111841]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 03 14:43:18.856130 dv-cinder-859877-2-iscsi devstack@n-api.service[111841]: Python main interpreter initialized at 0x55c1f9d469c0 Oct 03 14:43:18.856130 dv-cinder-859877-2-iscsi devstack@n-api.service[111841]: python threads support enabled Oct 03 14:43:18.856130 dv-cinder-859877-2-iscsi devstack@n-api.service[111841]: your server socket listen backlog is limited to 100 connections Oct 03 14:43:18.856130 dv-cinder-859877-2-iscsi devstack@n-api.service[111841]: your mercy for graceful operations on workers is 90 seconds Oct 03 14:43:18.856469 dv-cinder-859877-2-iscsi devstack@n-api.service[111841]: mapped 403077 bytes (393 KB) for 2 cores Oct 03 14:43:18.856552 dv-cinder-859877-2-iscsi devstack@n-api.service[111841]: *** Operational MODE: preforking *** Oct 03 14:43:18.856783 dv-cinder-859877-2-iscsi devstack@n-api.service[111841]: *** uWSGI is running in multiple interpreter mode *** Oct 03 14:43:18.856783 dv-cinder-859877-2-iscsi devstack@n-api.service[111841]: spawned uWSGI master process (pid: 111841) Oct 03 14:43:18.856955 dv-cinder-859877-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 03 14:43:18.860662 dv-cinder-859877-2-iscsi devstack@n-api.service[111841]: spawned uWSGI worker 1 (pid: 111842, cores: 1) Oct 03 14:43:18.860662 dv-cinder-859877-2-iscsi devstack@n-api.service[111841]: spawned uWSGI worker 2 (pid: 111843, cores: 1) Oct 03 14:43:18.860662 dv-cinder-859877-2-iscsi devstack@n-api.service[111841]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 03 14:43:19.508000 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 03 14:43:19.508589 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 03 14:43:20.591603 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 14:43:20.591603 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: from cryptography.utils import int_from_bytes Oct 03 14:43:20.592295 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 14:43:20.592295 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: from cryptography.utils import int_from_bytes Oct 03 14:43:20.593526 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 14:43:20.593526 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: from cryptography.utils import int_from_bytes Oct 03 14:43:20.593955 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 14:43:20.593955 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: from cryptography.utils import int_from_bytes Oct 03 14:43:23.098400 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 03 14:43:23.098962 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 03 14:43:23.099177 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 03 14:43:23.099541 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 03 14:43:23.099723 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 03 14:43:23.100084 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 03 14:43:23.100174 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 03 14:43:23.100266 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.100491 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.100578 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 03 14:43:23.100811 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.100916 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 03 14:43:23.101103 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 03 14:43:23.101196 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.101449 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.101564 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.102383 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.102482 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.102713 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.102806 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.103033 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.103129 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.103363 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.103460 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.103629 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.103721 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.103945 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.104035 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.104270 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859877-2-iscsi {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.104365 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.104592 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.104684 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.104855 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.104987 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.105171 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.105269 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.105517 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.105643 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859877-2-iscsi {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.105827 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.105924 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.106143 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.106230 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.106446 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.106536 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.106776 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.106938 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.107072 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.108345 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.108488 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.108596 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.108682 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.108820 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.108904 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.108999 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.109086 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.109170 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.109260 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.109345 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.109447 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.109557 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.109691 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.109842 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.110011 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.110118 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.110324 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.110483 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.110645 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.110864 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859877-2-iscsi {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.111020 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.111159 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.111291 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.111381 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.111566 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.111662 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.111961 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859877-2-iscsi {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.112053 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.112279 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.112379 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.112592 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.112700 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.112905 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.112995 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.113224 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.113317 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.113552 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.113660 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.113883 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.113981 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.114205 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.114294 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.114525 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.114625 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.114844 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.114937 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.115146 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.115238 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.115452 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.115551 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.115759 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.115845 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.116077 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.116169 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.116382 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.116468 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.116685 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.116770 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.116938 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.117030 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.117245 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.117331 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.117616 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.117706 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.117942 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.118041 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.118196 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.118289 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.118506 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.118590 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.118757 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.118858 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.119077 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.119163 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.119398 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.119499 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.119706 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.119818 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.119964 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.120077 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.120288 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.120383 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.120607 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.120699 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.120914 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.121011 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.121220 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.121305 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.121545 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.121635 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.121856 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.121952 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.122166 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.122261 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.122478 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.122563 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.122789 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.122882 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.123094 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.123195 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.123416 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.123506 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.123735 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.123820 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.124049 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.124156 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.124358 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.124458 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.124679 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.124763 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.125002 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.125095 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.125312 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.125412 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.125644 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.125741 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.125965 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.126058 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.126271 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.126365 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.126575 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.126667 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.126880 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.127008 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.127200 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.127285 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.127508 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.127599 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.127819 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.127918 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.128072 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.128185 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.128371 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.128464 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.128675 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.128768 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.128995 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.129081 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.129296 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.129389 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.129624 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.129727 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.129935 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.130034 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.130239 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.130352 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.130544 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.130631 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.130849 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.130946 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.131152 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.131245 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.131453 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.131544 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.131756 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.131841 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.132062 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.132155 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.132361 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.132453 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.132665 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.132757 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.132966 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.133059 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.133297 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.133382 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.133627 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.133718 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.133939 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.134040 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.134248 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.134350 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.134550 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.134652 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.134851 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.134960 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.135157 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.135259 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.135471 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.135565 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.135774 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.135957 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.136079 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.136195 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.136387 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.136473 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.136691 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.136788 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.136997 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.137089 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.137301 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.137395 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.137630 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.137733 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.137940 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.138026 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.138261 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.138386 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.138576 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.138700 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.138855 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.138945 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.139159 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.139243 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.139465 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.139550 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.139770 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.139867 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.140076 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.140171 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.140379 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.140475 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.140681 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.140767 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.140985 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.141070 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.141283 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.141368 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.141609 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.141709 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.141911 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.142006 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.142216 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.142308 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.142521 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.142607 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.142830 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.142923 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.143130 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.143215 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.143432 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.143516 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.143752 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.143850 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.144060 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.144144 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.144371 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.144478 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.144678 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.144784 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.145002 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:43:23.145104 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.145341 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.145448 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.145701 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.145805 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.146019 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.146109 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.146335 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.146427 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.146649 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.146742 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.146977 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.147062 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.147291 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.147384 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.147602 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.147695 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.147914 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.148004 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.148240 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.148332 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.148546 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.149148 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.149399 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.149537 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.149746 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.149833 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.150064 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.150150 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.150381 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.150461 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.150694 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.150799 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.151012 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.151103 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.151332 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.151415 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.151651 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.151744 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.151972 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.152062 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.152286 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.152380 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.152617 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.152716 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.152936 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.153042 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.153251 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.153354 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.153599 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.153705 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.153916 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.154003 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.154230 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.154317 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.154546 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.154632 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.154884 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.154968 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.155194 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.155278 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.155506 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.155590 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.155820 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.155909 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.156129 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.156221 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.156453 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.156547 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.156765 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.156851 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.157075 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.157221 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.157387 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.157474 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.157729 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.157829 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.158044 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.158128 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.158362 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.158492 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.158678 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.158764 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.158995 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.159089 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.159307 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.159392 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.159619 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.159705 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.159937 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.160030 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.160248 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.160334 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.160566 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.160658 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.160877 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.160970 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.161184 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.161276 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.161489 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.161603 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.161819 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.161917 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.162128 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.162220 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.162435 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.162519 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.162748 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.162834 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.163060 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.163145 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.163367 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.163451 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.163672 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.163757 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.163991 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.164074 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.164355 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.165022 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.165198 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.165292 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.165528 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.165660 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.165844 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.165932 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.166156 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.166243 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.166469 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.166554 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.166778 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.166871 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.167086 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.167179 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.167400 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.167484 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.167706 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.167804 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.168014 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.168098 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.168320 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.168404 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.168629 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.168774 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.168940 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.169076 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.169249 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.169379 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.169586 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.169733 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.169900 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.170029 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.170210 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.170339 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.170522 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.170657 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.170836 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.170964 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.171147 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.171287 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.171458 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.171595 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.171788 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.171918 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.172093 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.172221 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.172404 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.172532 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.172727 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.172855 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.173044 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.173180 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.173333 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.173469 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.173670 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.173799 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.173974 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.174119 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.174261 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.174401 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.174567 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.174708 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.174874 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.175016 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.175181 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.175323 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.175466 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.175598 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.175775 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.175921 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.176078 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.176204 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.176383 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.176513 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.176688 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.176836 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.176995 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.177139 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.177294 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.177426 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.177621 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.177720 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.177926 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.178019 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.178247 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.178331 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.178556 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.178699 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.178865 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.178952 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.179171 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.179265 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.179516 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.179604 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.179831 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.179916 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.180181 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.180265 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.180507 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.180601 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.180819 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.180904 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.181132 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.181228 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.181442 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.181576 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.181780 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.181866 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.182091 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.182187 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.182400 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.182484 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.182713 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.182798 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.183022 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.183115 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.183342 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.183433 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.183651 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.183736 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.183970 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.184067 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.184273 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.184364 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.184591 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.184675 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.184901 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.184994 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.185224 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.185309 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.185553 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.185651 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.185880 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.185997 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.186188 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.186285 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.186505 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.186599 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.186817 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.186906 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.187128 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.187215 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.187440 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.187541 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.187749 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.187838 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.188060 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.188144 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.188367 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.188451 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.188682 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.188819 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.188987 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.189071 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.189305 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.189388 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.189636 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.189724 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.189957 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.190042 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.190262 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.190359 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.190586 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.190670 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.190901 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.190986 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.191222 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.191321 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.191531 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.191624 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.191840 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.191932 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.192160 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.192259 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.192471 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.192556 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.192782 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.192867 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.193093 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.193186 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.193393 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.193484 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.193724 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.193811 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.194035 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.194121 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.194347 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.194443 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.194655 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.194739 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.194960 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.195045 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.195264 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.195348 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.195603 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.195687 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.195914 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.195999 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.196222 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.196308 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.196528 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.196612 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.196837 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.196921 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.197149 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.197239 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.197458 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.197631 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.197791 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.197877 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.198108 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.198192 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.198411 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.198504 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.198718 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.198807 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.199041 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.199189 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.199352 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.199452 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.199657 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.199741 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.199960 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.200051 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.200265 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.200359 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.200584 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.200669 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.200893 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.201020 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.201201 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.201287 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.201523 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.201612 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.201855 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.201938 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.202167 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.202252 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.202474 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.202558 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.202784 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.202867 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.203096 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.203182 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.203407 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.203499 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.203719 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.203822 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.204029 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.204115 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.204339 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.204424 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.204648 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.204743 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.204957 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.205042 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.205266 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.205358 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.205612 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.205714 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.205924 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.206055 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.206234 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.206320 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.206542 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.206670 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.206846 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.206938 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.207155 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.207248 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.207469 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.207570 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.207785 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.208036 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.208122 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.208373 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.208467 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.208694 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.208779 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.209020 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.209254 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.209347 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.209620 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.209724 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.209950 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.210037 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.210277 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.210362 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.210628 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.210725 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.210934 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.211027 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.211774 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.211874 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.212087 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.212173 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.212394 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.212494 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.212706 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.212792 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.213016 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.213102 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.213326 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.213410 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.213657 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.213744 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.213971 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.214056 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.214280 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.214372 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.214584 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.214669 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.214891 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.214976 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.215198 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.215285 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.215505 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.215596 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.215809 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.215901 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.216117 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.216200 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.216419 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.216503 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.216737 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.216833 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.217046 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.217130 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.217351 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.217436 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.217682 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.217780 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.217985 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.218078 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.218312 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.218396 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.218616 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.218708 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.218921 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.219013 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.219230 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.219376 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.219575 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.219711 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.219885 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.220025 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.220188 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.220316 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.220514 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.220650 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.220821 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.220956 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.221131 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.221264 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.221437 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.221553 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.221777 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.221862 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.222088 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.222180 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.222394 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.222488 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.222704 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.222790 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.223013 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.223107 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.223324 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.223407 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.223631 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.223722 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.223935 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.224028 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.224244 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.224328 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.224547 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.224630 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.224860 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.224952 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.225168 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.225254 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.225470 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.225638 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.225800 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.225899 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.226112 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.226241 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.226422 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.226508 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.226728 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.227413 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.227609 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.227701 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.227926 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.228012 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.228242 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.228328 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.228552 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.228636 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.228864 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.228948 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.229170 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.229254 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.229479 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.229582 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.229812 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.229897 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.230117 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.230210 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.230450 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.230603 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.230746 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.230891 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.231026 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.231160 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.231327 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.231457 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.231639 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.231781 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.231945 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.232082 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.232496 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.232633 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.232808 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.232947 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.233121 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.233252 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.233431 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.233594 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.233765 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.233905 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.234078 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.234212 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.234378 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.234511 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.234684 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.234828 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.234989 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.235120 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.235299 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.235427 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.235603 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.235745 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.235905 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.235996 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.236208 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.236330 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.236512 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.236599 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.236816 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.236899 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.237124 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.237210 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.237432 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.237537 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.237767 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.237896 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.238071 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.238172 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.238375 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.238461 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.238692 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.238776 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.239000 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.239094 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.239309 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.239395 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.239617 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.239701 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.239958 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.240050 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.240271 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.240355 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.240578 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.240663 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.240887 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.240981 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.241205 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.241291 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.241540 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.241680 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.241897 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.242039 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.242172 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.242311 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.242464 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.242605 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.242756 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.242889 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.243053 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.243182 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.243374 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.243507 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.243683 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.243820 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.243989 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.244121 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.244297 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.244431 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.244618 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.244762 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.244930 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.245064 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.245232 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.245365 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.245564 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.245698 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.245878 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.246007 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.246189 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.246328 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.246500 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.246597 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.246811 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.246903 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.247119 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.247215 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.247426 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.247529 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.247734 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.247829 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.248045 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.248137 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.248352 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.248443 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.248658 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.248744 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.248969 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.249061 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.249276 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.249398 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.249607 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.249697 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.249924 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.250009 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.250230 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.250321 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.250535 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.250674 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.250842 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.250934 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.251151 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.251244 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.251462 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.251590 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.251767 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.251854 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.252077 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.252199 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.252386 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.252484 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.252699 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.252783 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.253007 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.253088 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.253374 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.253471 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.253712 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.253799 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.254028 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.254120 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.254343 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.254436 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.254653 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.254738 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.254971 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.255075 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.255290 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.255382 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.255608 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.255692 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.255920 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.256004 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.256272 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.256364 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.256579 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.256666 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.256890 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.256982 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.257214 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.257322 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.257538 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.257639 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.257849 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.257942 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.258180 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.258313 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.258502 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.258647 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.258809 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.258958 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.259133 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.259268 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.259550 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.259636 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.259862 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.259954 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.260171 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.260258 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.260504 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.260588 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.260887 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.261043 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.261204 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.261337 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.261545 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.261695 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.261873 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.262028 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.262202 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.262341 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.262511 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.262641 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.262827 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.262968 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.263142 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.263279 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.263470 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.263600 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.263795 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.263976 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.264107 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.264246 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.264409 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.264539 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.264713 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.264841 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.265037 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.265176 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.265355 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.265589 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.265733 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.265866 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.266008 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.266140 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.266307 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.266437 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.266635 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.266769 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.266950 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.267090 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.267276 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.267406 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.267634 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.267768 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.267947 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.268098 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.268257 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.268393 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.268572 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.268842 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.268985 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.269173 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.269306 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.269488 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.269663 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.269807 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.269948 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.270128 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.270270 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.270439 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.270571 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.270754 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.270886 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.271070 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.271156 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.271377 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.271470 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.271690 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.271775 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.271996 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.272081 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.272308 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.272392 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.272620 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.272706 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.272930 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.273023 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.273251 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.273350 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.273581 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.274198 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.274426 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.274513 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.274743 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.274836 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.275048 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.275140 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.275355 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.275512 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.275665 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.275828 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.276010 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.276160 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.276320 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.276479 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.276646 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.276790 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.276983 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.277104 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.277317 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.277439 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.277657 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.277994 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.278323 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.278652 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.278766 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.278967 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.279117 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.279286 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.279459 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.279630 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.279815 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.279906 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.280217 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.280528 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.280854 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.280979 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.281141 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.281318 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.281452 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.281700 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.281789 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.282083 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.282388 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.282694 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.282839 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.283018 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.283191 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.283323 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.283528 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.283662 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.283865 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.283953 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.284239 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.284545 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.284851 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.285025 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.285194 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.285362 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.285554 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.285718 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.285854 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.286051 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.286169 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.286376 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.286498 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.286697 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.286819 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.287017 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.287137 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.287341 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.287454 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.287659 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.287794 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.287976 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.288062 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.288291 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.288386 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.288626 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.288721 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.288942 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.289043 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.289915 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.290015 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.290250 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.290356 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.290567 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.290661 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.290882 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.291113 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.291220 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.291445 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.291538 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.291769 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.291862 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.292088 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.292268 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.292405 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.292494 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.292722 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.292823 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.293036 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.293138 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.293350 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.293442 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.293705 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.293799 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.294019 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.294111 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.294659 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.294734 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.294800 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.294876 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.294944 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.295052 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.295267 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.295367 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.295604 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.295702 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.295924 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.296012 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.296238 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.296324 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.296554 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.296832 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.296920 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.297172 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.297259 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.297515 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.297622 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.297831 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.297924 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.298146 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.298234 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.298460 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.298555 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.298774 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.298868 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.299085 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.299173 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.299396 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.299488 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.299696 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.299782 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.300007 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.300094 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.300319 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.300406 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.300628 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.300723 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.300940 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.301026 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.301254 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.301341 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.301615 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.301708 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.301938 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.302041 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.302259 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.302354 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.302571 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.302657 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.302885 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.302979 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.303200 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.303293 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.303532 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.303718 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.303853 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.304035 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.304178 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.304374 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.304492 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.304703 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.304811 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.305055 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.305160 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.305375 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.305472 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.305722 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.305832 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.306050 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.306146 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.306360 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.306457 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.306667 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.306774 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.306979 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.307075 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.307289 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.307392 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.307595 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.307699 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.307919 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.308057 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.308231 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.308319 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.308535 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.308622 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.308852 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.308935 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.309160 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.309374 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.309713 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.309805 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.310051 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.310147 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.310368 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.310461 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.310694 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.310790 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.311013 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.311097 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.311329 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.311421 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.311642 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.311728 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.311956 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.312041 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.312263 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.312357 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.312569 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.312656 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.312881 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.312965 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.313193 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.313286 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.313512 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.313600 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.313824 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.313922 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.314135 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.314235 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.314450 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.314557 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.314757 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.314856 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.315066 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.315287 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.315392 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.315640 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.315736 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.315960 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.316065 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.316265 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.316358 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.316572 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.316667 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.316883 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.316990 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.317188 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.317283 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.317508 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.317606 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.317820 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.317924 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.318125 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.318224 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.318433 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.318529 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.318740 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.318871 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.319052 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.319137 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.319356 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.319441 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.319667 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.319754 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.319980 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.320065 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.320293 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.320394 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.321124 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.321223 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.321435 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.321557 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.321766 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.321865 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.322079 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.322167 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.322388 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.322474 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.322696 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.322790 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.323006 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.323091 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.323314 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.323400 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.323621 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.323721 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.323929 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.324015 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.324293 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.324398 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.324613 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.324820 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.324909 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.325154 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.325242 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.325477 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.325584 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.325834 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.325923 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.326165 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.326260 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.326475 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.326572 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.326785 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.326881 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.327089 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.327184 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.327401 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.327496 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.327711 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.327798 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.328023 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.328108 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.328337 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.328442 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.328647 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.328734 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.328958 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.329060 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.329270 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.329359 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.329610 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.329712 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.329923 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.330011 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.330235 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.330474 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.330569 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.330819 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.330915 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.331137 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.331231 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.331444 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.331541 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.331753 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.331839 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.332073 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.332168 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.332400 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.332485 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.332716 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.332803 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.333029 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.333115 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.333344 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.333430 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.333686 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.333775 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.333999 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.334088 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.334311 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.334397 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.334621 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.334754 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.334931 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.335026 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.335242 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.335334 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.335558 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.335661 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.335868 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.335953 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.336229 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.336804 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.337036 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.337354 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.337463 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.337694 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.337797 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.338012 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.338129 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.338330 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.338454 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.338677 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.338764 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.339004 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.339132 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.339327 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.339426 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.339647 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.339741 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.339969 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.340073 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.340283 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.340379 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.340599 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.340717 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.340913 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.341018 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.341226 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.341321 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.341563 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.341672 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.341901 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.341989 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.342211 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.342303 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.342517 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.342601 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.342826 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.343147 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.343232 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.343461 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.343548 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.343769 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.343863 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.344076 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.344163 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.344388 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.344473 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.344694 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.344849 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.345000 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.345088 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.345306 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.345391 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.345636 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.345724 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.345951 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.346036 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.346256 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.346353 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.346561 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.346648 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.346866 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.347110 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.347203 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.347283 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.347465 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.347594 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.347769 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.347906 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.348078 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.348217 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.348383 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.348575 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.348733 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.348878 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.349014 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.349175 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.349261 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.349438 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.349576 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.349773 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.349912 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.350087 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.350248 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.350398 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.350564 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.350706 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.350891 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.351052 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.351198 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.351333 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.351507 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.351638 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.351844 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.351986 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.352175 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.352331 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.352533 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.352665 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.352852 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.352982 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.353162 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.353290 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.353467 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.353574 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.353802 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.353890 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.354113 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.354197 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.354420 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.354511 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.354726 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.354813 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.355034 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.355124 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.355341 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.355435 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.355665 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.355751 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.355991 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.356078 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.356301 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.356396 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.356624 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.356720 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.356937 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.357023 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.357539 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.357665 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.357842 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.357934 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.358149 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.358233 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.358482 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.358635 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.358795 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.358930 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.359107 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.359241 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.359402 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.359485 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.359712 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.359800 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.360022 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.360110 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.360339 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.360435 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.360649 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.360735 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.360963 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.361119 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.361258 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.361390 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.361615 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.361750 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.361946 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.362084 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.362259 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.362394 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.362573 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.362706 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.362895 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.363034 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.363219 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.363353 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.363538 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.363668 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.363852 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.363989 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.364191 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.364334 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.364502 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.364636 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.364816 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.364951 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.365125 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.365214 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.365432 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.365548 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.365702 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 03 14:43:23.365796 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.366076 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.366390 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.366706 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.367026 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.367361 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.367698 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.368029 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.368346 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.368678 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.369008 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.369359 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.369699 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.370049 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.370387 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.370708 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.371025 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.371337 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:43:23.371586 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 03 14:43:23.519131 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO dbcounter [None req-e7a2cdc6-ea58-423d-9126-aa1158c08d93 None None] Registered counter for database nova_api Oct 03 14:43:23.525235 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO dbcounter [None req-bebf99d1-579d-46c8-a1ce-23023bab36a1 None None] Registered counter for database nova_api Oct 03 14:43:23.541112 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG oslo_db.sqlalchemy.engines [None req-e7a2cdc6-ea58-423d-9126-aa1158c08d93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 14:43:23.546022 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG oslo_db.sqlalchemy.engines [None req-bebf99d1-579d-46c8-a1ce-23023bab36a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 14:43:23.547799 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG dbcounter [-] [111842] Writer thread running {{(pid=111842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 14:43:23.552578 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG dbcounter [-] [111843] Writer thread running {{(pid=111843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 14:43:23.604644 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.context [None req-e7a2cdc6-ea58-423d-9126-aa1158c08d93 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),be5c6f43-0ff9-4454-a14a-9cca214f362b(cell1) {{(pid=111842) load_cells /opt/stack/nova/nova/context.py:464}} Oct 03 14:43:23.608763 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG oslo_concurrency.lockutils [None req-e7a2cdc6-ea58-423d-9126-aa1158c08d93 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:23.609235 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG oslo_concurrency.lockutils [None req-e7a2cdc6-ea58-423d-9126-aa1158c08d93 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:23.610817 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG oslo_concurrency.lockutils [None req-e7a2cdc6-ea58-423d-9126-aa1158c08d93 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:23.611546 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG oslo_concurrency.lockutils [None req-e7a2cdc6-ea58-423d-9126-aa1158c08d93 None None] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:23.611997 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG oslo_concurrency.lockutils [None req-e7a2cdc6-ea58-423d-9126-aa1158c08d93 None None] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:23.613810 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.context [None req-bebf99d1-579d-46c8-a1ce-23023bab36a1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),be5c6f43-0ff9-4454-a14a-9cca214f362b(cell1) {{(pid=111843) load_cells /opt/stack/nova/nova/context.py:464}} Oct 03 14:43:23.614008 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG oslo_concurrency.lockutils [None req-e7a2cdc6-ea58-423d-9126-aa1158c08d93 None None] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:23.615988 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO dbcounter [None req-e7a2cdc6-ea58-423d-9126-aa1158c08d93 None None] Registered counter for database nova_cell0 Oct 03 14:43:23.617711 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG oslo_concurrency.lockutils [None req-bebf99d1-579d-46c8-a1ce-23023bab36a1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:23.618190 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG oslo_concurrency.lockutils [None req-bebf99d1-579d-46c8-a1ce-23023bab36a1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:23.619835 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG oslo_concurrency.lockutils [None req-bebf99d1-579d-46c8-a1ce-23023bab36a1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:23.620012 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO dbcounter [None req-e7a2cdc6-ea58-423d-9126-aa1158c08d93 None None] Registered counter for database nova_cell1 Oct 03 14:43:23.620571 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG oslo_concurrency.lockutils [None req-bebf99d1-579d-46c8-a1ce-23023bab36a1 None None] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:23.621024 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG oslo_concurrency.lockutils [None req-bebf99d1-579d-46c8-a1ce-23023bab36a1 None None] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:23.623128 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG oslo_concurrency.lockutils [None req-bebf99d1-579d-46c8-a1ce-23023bab36a1 None None] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:23.625130 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO dbcounter [None req-bebf99d1-579d-46c8-a1ce-23023bab36a1 None None] Registered counter for database nova_cell0 Oct 03 14:43:23.627092 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG oslo_db.sqlalchemy.engines [None req-e7a2cdc6-ea58-423d-9126-aa1158c08d93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 14:43:23.628714 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG oslo_db.sqlalchemy.engines [None req-e7a2cdc6-ea58-423d-9126-aa1158c08d93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 14:43:23.629394 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO dbcounter [None req-bebf99d1-579d-46c8-a1ce-23023bab36a1 None None] Registered counter for database nova_cell1 Oct 03 14:43:23.634825 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG dbcounter [-] [111842] Writer thread running {{(pid=111842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 14:43:23.637632 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG dbcounter [-] [111842] Writer thread running {{(pid=111842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 14:43:23.638376 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG oslo_db.sqlalchemy.engines [None req-bebf99d1-579d-46c8-a1ce-23023bab36a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 14:43:23.639526 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG oslo_db.sqlalchemy.engines [None req-bebf99d1-579d-46c8-a1ce-23023bab36a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 14:43:23.645806 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG dbcounter [-] [111843] Writer thread running {{(pid=111843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 14:43:23.648013 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG dbcounter [-] [111843] Writer thread running {{(pid=111843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 14:43:23.782138 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO dbcounter [None req-e7a2cdc6-ea58-423d-9126-aa1158c08d93 None None] Registered counter for database nova_cell0 Oct 03 14:43:23.791488 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG oslo_db.sqlalchemy.engines [None req-e7a2cdc6-ea58-423d-9126-aa1158c08d93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 14:43:23.793384 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO dbcounter [None req-bebf99d1-579d-46c8-a1ce-23023bab36a1 None None] Registered counter for database nova_cell0 Oct 03 14:43:23.796176 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG dbcounter [-] [111842] Writer thread running {{(pid=111842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 14:43:23.802034 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG oslo_db.sqlalchemy.engines [None req-bebf99d1-579d-46c8-a1ce-23023bab36a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 14:43:23.806868 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG dbcounter [-] [111843] Writer thread running {{(pid=111843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 14:43:24.135277 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: WARNING keystonemiddleware.auth_token [None req-e7a2cdc6-ea58-423d-9126-aa1158c08d93 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 14:43:24.141536 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: WARNING keystonemiddleware.auth_token [None req-bebf99d1-579d-46c8-a1ce-23023bab36a1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 14:43:24.142561 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: WARNING keystonemiddleware.auth_token [None req-e7a2cdc6-ea58-423d-9126-aa1158c08d93 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 14:43:24.149994 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: WARNING keystonemiddleware.auth_token [None req-bebf99d1-579d-46c8-a1ce-23023bab36a1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 14:43:24.483402 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: WARNING keystonemiddleware.auth_token [None req-e7a2cdc6-ea58-423d-9126-aa1158c08d93 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 14:43:24.489351 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: WARNING keystonemiddleware.auth_token [None req-e7a2cdc6-ea58-423d-9126-aa1158c08d93 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 14:43:24.493316 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: WARNING keystonemiddleware.auth_token [None req-bebf99d1-579d-46c8-a1ce-23023bab36a1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 14:43:24.495174 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c1f9d469c0 pid: 111842 (default app) Oct 03 14:43:24.497229 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-e7a2cdc6-ea58-423d-9126-aa1158c08d93 None None] Calling method '>' {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:24.498442 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-e7a2cdc6-ea58-423d-9126-aa1158c08d93 None None] 10.222.0.46 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001747 Oct 03 14:43:24.498855 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 788 bytes} [Mon Oct 3 14:43:24 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:43:24.499326 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: WARNING keystonemiddleware.auth_token [None req-bebf99d1-579d-46c8-a1ce-23023bab36a1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 14:43:24.504545 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c1f9d469c0 pid: 111843 (default app) Oct 03 14:44:45.518527 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-e7a2cdc6-ea58-423d-9126-aa1158c08d93 None None] Calling method '>' {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:45.519561 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-e7a2cdc6-ea58-423d-9126-aa1158c08d93 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Oct 03 14:44:45.519954 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 2/2] 10.222.0.46 () {54 vars in 931 bytes} [Mon Oct 3 14:44:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:45.536765 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG dbcounter [-] [111843] Writing DB stats nova_api:SELECT=3 {{(pid=111843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:45.537670 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG dbcounter [-] [111843] Writing DB stats nova_cell0:SELECT=3 {{(pid=111843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:45.538519 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG dbcounter [-] [111843] Writing DB stats nova_cell1:SELECT=3 {{(pid=111843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:45.539590 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG dbcounter [-] [111843] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:46.380769 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-8c681e86-e8c0-4f1d-81e5-d11f4434eabc admin admin] Calling method '>' {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:46.412972 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.requestlog [None req-8c681e86-e8c0-4f1d-81e5-d11f4434eabc admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.886205 Oct 03 14:44:46.413763 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: [pid: 111843|app: 0|req: 1/3] 10.222.0.46 () {60 vars in 1292 bytes} [Mon Oct 3 14:44:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:49.023410 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-e7a2cdc6-ea58-423d-9126-aa1158c08d93 None None] Calling method '>' {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:49.024801 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-e7a2cdc6-ea58-423d-9126-aa1158c08d93 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001602 Oct 03 14:44:49.025709 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 3/4] 10.222.0.46 () {54 vars in 931 bytes} [Mon Oct 3 14:44:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:49.459143 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-e4514742-34a4-4c61-b915-5a994206a8e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 256, "name": "cirros256", "id": "c1"}} {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:49.505913 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.requestlog [None req-e4514742-34a4-4c61-b915-5a994206a8e1 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.474041 Oct 03 14:44:49.506408 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: [pid: 111843|app: 0|req: 2/5] 10.222.0.46 () {64 vars in 1283 bytes} [Mon Oct 3 14:44:49 2022] POST /compute/v2.1/flavors => generated 407 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:44:49.520270 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG dbcounter [-] [111842] Writing DB stats nova_api:SELECT=3 {{(pid=111842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:49.521200 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG dbcounter [-] [111842] Writing DB stats nova_cell1:SELECT=3 {{(pid=111842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:49.523232 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG dbcounter [-] [111842] Writing DB stats nova_cell0:SELECT=3 {{(pid=111842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:49.524039 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG dbcounter [-] [111842] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:49.730455 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-515fe5ae-f0f2-4307-8354-1978f8fc3264 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:49.799077 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-515fe5ae-f0f2-4307-8354-1978f8fc3264 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284340 Oct 03 14:44:49.799589 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 4/6] 10.222.0.46 () {64 vars in 1336 bytes} [Mon Oct 3 14:44:49 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:52.386548 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-e4514742-34a4-4c61-b915-5a994206a8e1 admin admin] Calling method '>' {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:52.387574 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.requestlog [None req-e4514742-34a4-4c61-b915-5a994206a8e1 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Oct 03 14:44:52.388295 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: [pid: 111843|app: 0|req: 3/7] 10.222.0.46 () {54 vars in 931 bytes} [Mon Oct 3 14:44:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:53.039228 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-f8406d6a-9244-42c4-9b06-9fd31ee3233f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "id": "d1", "rxtx_factor": 1.0, "name": "ds512M", "ram": 512, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:53.077660 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-f8406d6a-9244-42c4-9b06-9fd31ee3233f admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.682303 Oct 03 14:44:53.078631 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 5/8] 10.222.0.46 () {64 vars in 1283 bytes} [Mon Oct 3 14:44:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:44:53.090748 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-f246724a-5372-4256-8204-c6bc0e12b894 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:53.135093 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.requestlog [None req-f246724a-5372-4256-8204-c6bc0e12b894 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048283 Oct 03 14:44:53.137657 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: [pid: 111843|app: 0|req: 4/9] 10.222.0.46 () {64 vars in 1336 bytes} [Mon Oct 3 14:44:53 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:55.726005 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-f8406d6a-9244-42c4-9b06-9fd31ee3233f admin admin] Calling method '>' {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:55.727021 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-f8406d6a-9244-42c4-9b06-9fd31ee3233f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Oct 03 14:44:55.727617 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 6/10] 10.222.0.46 () {54 vars in 931 bytes} [Mon Oct 3 14:44:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:56.154972 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-a1735468-7ac4-4eff-b969-66e5ba9feddf admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds1G", "rxtx_factor": 1.0, "swap": 0, "ram": 1024, "vcpus": 1, "id": "d2", "disk": 10}} {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:56.174283 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.requestlog [None req-a1735468-7ac4-4eff-b969-66e5ba9feddf admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.439710 Oct 03 14:44:56.175384 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: [pid: 111843|app: 0|req: 5/11] 10.222.0.46 () {64 vars in 1283 bytes} [Mon Oct 3 14:44:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:44:56.187630 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-ffad97e4-d6d5-4273-82a7-51dbae8d6bab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:56.215098 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-ffad97e4-d6d5-4273-82a7-51dbae8d6bab admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031108 Oct 03 14:44:56.215677 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 7/12] 10.222.0.46 () {64 vars in 1336 bytes} [Mon Oct 3 14:44:56 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:58.821562 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-a1735468-7ac4-4eff-b969-66e5ba9feddf admin admin] Calling method '>' {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:58.822538 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.requestlog [None req-a1735468-7ac4-4eff-b969-66e5ba9feddf admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Oct 03 14:44:58.822947 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: [pid: 111843|app: 0|req: 6/13] 10.222.0.46 () {54 vars in 931 bytes} [Mon Oct 3 14:44:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:59.240102 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-2172a625-5052-4e94-97e1-1eb50eae2126 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "name": "ds2G", "ram": 2048, "disk": 10, "os-flavor-access:is_public": true, "id": "d3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:59.262275 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-2172a625-5052-4e94-97e1-1eb50eae2126 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.433206 Oct 03 14:44:59.263023 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 8/14] 10.222.0.46 () {64 vars in 1283 bytes} [Mon Oct 3 14:44:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 14:44:59.275507 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-64946d7d-8c24-4d4e-b99e-ad66c3c92ebb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:59.303807 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.requestlog [None req-64946d7d-8c24-4d4e-b99e-ad66c3c92ebb admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032236 Oct 03 14:44:59.310283 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: [pid: 111843|app: 0|req: 7/15] 10.222.0.46 () {64 vars in 1336 bytes} [Mon Oct 3 14:44:59 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:01.903377 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-2172a625-5052-4e94-97e1-1eb50eae2126 admin admin] Calling method '>' {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:01.904376 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-2172a625-5052-4e94-97e1-1eb50eae2126 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Oct 03 14:45:01.905033 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 9/16] 10.222.0.46 () {54 vars in 931 bytes} [Mon Oct 3 14:45:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:02.320728 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-98758bec-d5f9-484d-b71f-ece13251f5c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "vcpus": 4, "id": "d4"}} {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:02.340074 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.requestlog [None req-98758bec-d5f9-484d-b71f-ece13251f5c7 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.428634 Oct 03 14:45:02.340653 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: [pid: 111843|app: 0|req: 8/17] 10.222.0.46 () {64 vars in 1283 bytes} [Mon Oct 3 14:45:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 14:45:02.353667 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-e06cfb4b-3278-4df6-8bbb-0ca01c976070 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:02.380245 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-e06cfb4b-3278-4df6-8bbb-0ca01c976070 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030254 Oct 03 14:45:02.380689 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 10/18] 10.222.0.46 () {64 vars in 1336 bytes} [Mon Oct 3 14:45:02 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:05.422950 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-98758bec-d5f9-484d-b71f-ece13251f5c7 admin admin] Calling method '>' {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:05.423981 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.requestlog [None req-98758bec-d5f9-484d-b71f-ece13251f5c7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Oct 03 14:45:05.424394 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: [pid: 111843|app: 0|req: 9/19] 10.222.0.46 () {54 vars in 931 bytes} [Mon Oct 3 14:45:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:05.860066 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-08fb78a8-d7b5-40df-97bb-68b82eb58286 admin admin] Calling method '>' {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:05.891804 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-08fb78a8-d7b5-40df-97bb-68b82eb58286 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.461045 Oct 03 14:45:05.892493 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 11/20] 10.222.0.46 () {60 vars in 1292 bytes} [Mon Oct 3 14:45:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:45:08.471631 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-98758bec-d5f9-484d-b71f-ece13251f5c7 admin admin] Calling method '>' {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:08.472711 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.requestlog [None req-98758bec-d5f9-484d-b71f-ece13251f5c7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001588 Oct 03 14:45:08.473175 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: [pid: 111843|app: 0|req: 10/21] 10.222.0.46 () {54 vars in 931 bytes} [Mon Oct 3 14:45:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:08.901190 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-4b2c1189-6f7d-4b88-bb46-681249dd6733 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0, "rxtx_factor": 1.0, "ram": 512, "vcpus": 1, "name": "m1.tiny", "os-flavor-access:is_public": true, "id": "1"}} {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:08.920591 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-4b2c1189-6f7d-4b88-bb46-681249dd6733 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.441121 Oct 03 14:45:08.921132 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 12/22] 10.222.0.46 () {64 vars in 1283 bytes} [Mon Oct 3 14:45:08 2022] POST /compute/v2.1/flavors => generated 402 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:45:08.933522 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-90ae2000-f381-4d23-a74d-b259903cc066 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:08.961147 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.requestlog [None req-90ae2000-f381-4d23-a74d-b259903cc066 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031195 Oct 03 14:45:08.961781 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: [pid: 111843|app: 0|req: 11/23] 10.222.0.46 () {64 vars in 1333 bytes} [Mon Oct 3 14:45:08 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:11.538655 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-4b2c1189-6f7d-4b88-bb46-681249dd6733 admin admin] Calling method '>' {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:11.539958 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-4b2c1189-6f7d-4b88-bb46-681249dd6733 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001754 Oct 03 14:45:11.540393 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 13/24] 10.222.0.46 () {54 vars in 931 bytes} [Mon Oct 3 14:45:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:11.961708 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-c7913da0-af57-4d31-a579-95100025a21f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "ram": 2048, "rxtx_factor": 1.0, "id": "2", "name": "m1.small", "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:11.981864 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.requestlog [None req-c7913da0-af57-4d31-a579-95100025a21f admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.435219 Oct 03 14:45:11.985653 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: [pid: 111843|app: 0|req: 12/25] 10.222.0.46 () {64 vars in 1283 bytes} [Mon Oct 3 14:45:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:45:11.995090 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-a694932f-b4af-4111-aeac-26be953ff315 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:12.023797 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-a694932f-b4af-4111-aeac-26be953ff315 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032591 Oct 03 14:45:12.024837 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 14/26] 10.222.0.46 () {64 vars in 1333 bytes} [Mon Oct 3 14:45:11 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:45:14.714249 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-c7913da0-af57-4d31-a579-95100025a21f admin admin] Calling method '>' {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:14.715893 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.requestlog [None req-c7913da0-af57-4d31-a579-95100025a21f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002122 Oct 03 14:45:14.716457 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: [pid: 111843|app: 0|req: 13/27] 10.222.0.46 () {54 vars in 931 bytes} [Mon Oct 3 14:45:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:15.162227 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-80e4a614-a71f-4700-b76d-885603480051 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 40, "vcpus": 2, "id": "3", "rxtx_factor": 1.0, "ram": 4096}} {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:15.189211 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-80e4a614-a71f-4700-b76d-885603480051 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.466591 Oct 03 14:45:15.190156 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 15/28] 10.222.0.46 () {64 vars in 1283 bytes} [Mon Oct 3 14:45:14 2022] POST /compute/v2.1/flavors => generated 406 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:45:15.202192 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-f4854703-5ce6-4ef6-ae50-d7fc3570f786 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:15.229889 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.requestlog [None req-f4854703-5ce6-4ef6-ae50-d7fc3570f786 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031069 Oct 03 14:45:15.231139 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: [pid: 111843|app: 0|req: 14/29] 10.222.0.46 () {64 vars in 1333 bytes} [Mon Oct 3 14:45:15 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:45:17.897847 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-80e4a614-a71f-4700-b76d-885603480051 admin admin] Calling method '>' {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:17.898947 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-80e4a614-a71f-4700-b76d-885603480051 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001587 Oct 03 14:45:17.899351 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 16/30] 10.222.0.46 () {54 vars in 931 bytes} [Mon Oct 3 14:45:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:18.360341 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-d36bef02-9aca-4d21-9239-b6478c0e1086 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.large", "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "ram": 8192, "os-flavor-access:is_public": true, "disk": 80}} {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:18.367394 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG dbcounter [-] [111843] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=111843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:18.385785 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.requestlog [None req-d36bef02-9aca-4d21-9239-b6478c0e1086 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.480323 Oct 03 14:45:18.386439 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: [pid: 111843|app: 0|req: 15/31] 10.222.0.46 () {64 vars in 1283 bytes} [Mon Oct 3 14:45:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:45:18.400041 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-51e9b106-6cda-491a-93ac-1270252457e5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:18.429806 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-51e9b106-6cda-491a-93ac-1270252457e5 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034279 Oct 03 14:45:18.441540 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 17/32] 10.222.0.46 () {64 vars in 1333 bytes} [Mon Oct 3 14:45:18 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:21.079856 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-d36bef02-9aca-4d21-9239-b6478c0e1086 admin admin] Calling method '>' {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:21.080967 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.requestlog [None req-d36bef02-9aca-4d21-9239-b6478c0e1086 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Oct 03 14:45:21.081377 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: [pid: 111843|app: 0|req: 16/33] 10.222.0.46 () {54 vars in 931 bytes} [Mon Oct 3 14:45:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:21.526490 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-597a2159-ff49-46c1-aa18-7a127e36a5cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "disk": 160, "vcpus": 8, "ram": 16384, "os-flavor-access:is_public": true, "id": "5", "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:21.533152 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG dbcounter [-] [111842] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=111842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:21.548032 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-597a2159-ff49-46c1-aa18-7a127e36a5cc admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.460654 Oct 03 14:45:21.553921 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 18/34] 10.222.0.46 () {64 vars in 1283 bytes} [Mon Oct 3 14:45:21 2022] POST /compute/v2.1/flavors => generated 408 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:45:21.561276 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-85896407-6836-41db-9d52-eb870e5bd528 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:21.588625 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.requestlog [None req-85896407-6836-41db-9d52-eb870e5bd528 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031113 Oct 03 14:45:21.601836 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: [pid: 111843|app: 0|req: 17/35] 10.222.0.46 () {64 vars in 1333 bytes} [Mon Oct 3 14:45:21 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:45:38.624495 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-597a2159-ff49-46c1-aa18-7a127e36a5cc admin admin] Calling method '>' {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:38.625983 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-597a2159-ff49-46c1-aa18-7a127e36a5cc admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Oct 03 14:45:38.626389 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 19/36] 10.222.0.46 () {54 vars in 931 bytes} [Mon Oct 3 14:45:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:38.636815 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG dbcounter [-] [111843] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=111843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:39.010744 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-cbf26420-48e7-4567-b41a-74a42e8a64fe admin admin] Calling method '>' {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:39.028706 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.requestlog [None req-cbf26420-48e7-4567-b41a-74a42e8a64fe admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.396321 Oct 03 14:45:39.029238 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: [pid: 111843|app: 0|req: 18/37] 10.222.0.46 () {60 vars in 1292 bytes} [Mon Oct 3 14:45:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:45:40.317542 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-597a2159-ff49-46c1-aa18-7a127e36a5cc admin admin] Calling method '>' {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:40.318557 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-597a2159-ff49-46c1-aa18-7a127e36a5cc admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Oct 03 14:45:40.318957 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 20/38] 10.222.0.46 () {56 vars in 1074 bytes} [Mon Oct 3 14:45:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:40.834645 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-cccc1af8-3e21-4497-9dba-f8ac458d4908 admin admin] Calling method '>' {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:40.839840 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.wsgi [None req-cccc1af8-3e21-4497-9dba-f8ac458d4908 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 03 14:45:40.843093 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-cccc1af8-3e21-4497-9dba-f8ac458d4908 admin admin] Request method failure captured: Oct 03 14:45:40.843093 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 03 14:45:40.843093 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: Accept: application/json Oct 03 14:45:40.843093 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: Accept-Encoding: gzip, deflate Oct 03 14:45:40.843093 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: Connection: keep-alive Oct 03 14:45:40.843093 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: Content-Length: 0 Oct 03 14:45:40.843093 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: Host: 10.222.0.46 Oct 03 14:45:40.843093 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: Openstack-Api-Version: compute 2.92 Oct 03 14:45:40.843093 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: Openstack-System-Scope: None Oct 03 14:45:40.843093 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: User-Agent: python-novaclient Oct 03 14:45:40.843093 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Auth-Token: gAAAAABjOvWUfamfM73W3i4Tmcpm21d6XY1SGLtTUfJaoFwvqkJ4z8_JyGBufIY3tPbElqEXL9ishWSozfYWFsqAByluX-eE8Wkf4uhZ6idmcdqK4jfyMYpi-5Ewn8JuJCZ1zCRrGEzr73EGNRBPBSBermQcjr72yepknJPedDg9pURe1bxxUzc Oct 03 14:45:40.843093 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Domain-Id: None Oct 03 14:45:40.843093 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Domain-Name: None Oct 03 14:45:40.843093 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Identity-Status: Confirmed Oct 03 14:45:40.843093 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Is-Admin-Project: True Oct 03 14:45:40.843093 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Openstack-Nova-Api-Version: 2.92 Oct 03 14:45:40.843093 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Project-Domain-Id: default Oct 03 14:45:40.843093 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Project-Domain-Name: Default Oct 03 14:45:40.843093 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Project-Id: 47484d92809b4b9a846447c512be0a94 Oct 03 14:45:40.843093 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Project-Name: admin Oct 03 14:45:40.843093 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Role: admin,member,reader Oct 03 14:45:40.843093 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Roles: admin,member,reader Oct 03 14:45:40.845273 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/47484d92809b4b9a846447c512be0a94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_47484d92809b4b9a846447c512be0a94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/47484d92809b4b9a846447c512be0a94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/47484d92809b4b9a846447c512be0a94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 14:45:40.845273 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Tenant: admin Oct 03 14:45:40.845273 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Tenant-Id: 47484d92809b4b9a846447c512be0a94 Oct 03 14:45:40.845273 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Tenant-Name: admin Oct 03 14:45:40.845273 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-User: admin Oct 03 14:45:40.845273 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-User-Domain-Id: default Oct 03 14:45:40.845273 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-User-Domain-Name: Default Oct 03 14:45:40.845273 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-User-Id: dd9397aad94548f284667a53c0b499d2 Oct 03 14:45:40.845273 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-User-Name: admin Oct 03 14:45:40.845273 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: method: > Oct 03 14:45:40.845273 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: exception: Flavor 42 could not be found. Oct 03 14:45:40.845273 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: action_args: {'id': '42'} Oct 03 14:45:40.845273 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:45:40.845273 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:40.846359 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 03 14:45:40.846359 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 03 14:45:40.846359 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 14:45:40.846359 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 14:45:40.846359 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:45:40.846359 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:45:40.846359 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 14:45:40.846359 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 14:45:40.846359 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 14:45:40.846359 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:45:40.846359 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 14:45:40.846359 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 14:45:40.846359 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 03 14:45:40.846359 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi Oct 03 14:45:40.846359 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:45:40.846359 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi Oct 03 14:45:40.846359 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:40.846359 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:45:40.846359 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:45:40.847704 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:45:40.847704 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:45:40.847704 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:45:40.847704 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:45:40.847704 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 03 14:45:40.847704 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:45:40.847704 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 03 14:45:40.847704 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi Oct 03 14:45:40.847704 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:45:40.847704 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi Oct 03 14:45:40.847704 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:40.847704 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:45:40.847704 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:45:40.847704 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:45:40.847704 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:45:40.847704 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 03 14:45:40.847704 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi Oct 03 14:45:40.847704 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-cccc1af8-3e21-4497-9dba-f8ac458d4908 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:45:40.848954 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.requestlog [None req-cccc1af8-3e21-4497-9dba-f8ac458d4908 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.387941 Oct 03 14:45:40.848954 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: [pid: 111843|app: 0|req: 19/39] 10.222.0.46 () {60 vars in 1190 bytes} [Mon Oct 3 14:45:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 03 14:45:40.855162 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-ea10322a-b8d6-48a4-838d-90a275ec8c56 admin admin] Calling method '>' {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:40.878325 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-ea10322a-b8d6-48a4-838d-90a275ec8c56 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026998 Oct 03 14:45:40.878854 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 21/40] 10.222.0.46 () {60 vars in 1210 bytes} [Mon Oct 3 14:45:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:45:40.889301 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-23b8797b-3f59-48b6-8ad5-9ae196ee4c64 admin admin] Calling method '>' {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:40.911686 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.requestlog [None req-23b8797b-3f59-48b6-8ad5-9ae196ee4c64 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026800 Oct 03 14:45:40.912207 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: [pid: 111843|app: 0|req: 20/41] 10.222.0.46 () {60 vars in 1210 bytes} [Mon Oct 3 14:45:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:45:40.921415 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-62bf1fe8-8044-4fb4-8590-239e4b6cd52b admin admin] Calling method '>' {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:40.926991 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.wsgi [None req-62bf1fe8-8044-4fb4-8590-239e4b6cd52b admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 03 14:45:40.930362 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-62bf1fe8-8044-4fb4-8590-239e4b6cd52b admin admin] Request method failure captured: Oct 03 14:45:40.930362 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 03 14:45:40.930362 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: Accept: application/json Oct 03 14:45:40.930362 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: Accept-Encoding: gzip, deflate Oct 03 14:45:40.930362 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: Connection: keep-alive Oct 03 14:45:40.930362 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: Content-Length: 0 Oct 03 14:45:40.930362 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: Host: 10.222.0.46 Oct 03 14:45:40.930362 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: Openstack-Api-Version: compute 2.92 Oct 03 14:45:40.930362 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: Openstack-System-Scope: None Oct 03 14:45:40.930362 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: User-Agent: python-novaclient Oct 03 14:45:40.930362 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Auth-Token: gAAAAABjOvWUfamfM73W3i4Tmcpm21d6XY1SGLtTUfJaoFwvqkJ4z8_JyGBufIY3tPbElqEXL9ishWSozfYWFsqAByluX-eE8Wkf4uhZ6idmcdqK4jfyMYpi-5Ewn8JuJCZ1zCRrGEzr73EGNRBPBSBermQcjr72yepknJPedDg9pURe1bxxUzc Oct 03 14:45:40.930362 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Domain-Id: None Oct 03 14:45:40.930362 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Domain-Name: None Oct 03 14:45:40.930362 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Identity-Status: Confirmed Oct 03 14:45:40.930362 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Is-Admin-Project: True Oct 03 14:45:40.930362 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Openstack-Nova-Api-Version: 2.92 Oct 03 14:45:40.930362 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Project-Domain-Id: default Oct 03 14:45:40.930362 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Project-Domain-Name: Default Oct 03 14:45:40.930362 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Project-Id: 47484d92809b4b9a846447c512be0a94 Oct 03 14:45:40.930362 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Project-Name: admin Oct 03 14:45:40.930362 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Role: admin,member,reader Oct 03 14:45:40.930362 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Roles: admin,member,reader Oct 03 14:45:40.931974 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/47484d92809b4b9a846447c512be0a94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_47484d92809b4b9a846447c512be0a94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/47484d92809b4b9a846447c512be0a94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/47484d92809b4b9a846447c512be0a94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 14:45:40.931974 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Tenant: admin Oct 03 14:45:40.931974 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Tenant-Id: 47484d92809b4b9a846447c512be0a94 Oct 03 14:45:40.931974 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Tenant-Name: admin Oct 03 14:45:40.931974 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-User: admin Oct 03 14:45:40.931974 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-User-Domain-Id: default Oct 03 14:45:40.931974 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-User-Domain-Name: Default Oct 03 14:45:40.931974 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-User-Id: dd9397aad94548f284667a53c0b499d2 Oct 03 14:45:40.931974 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-User-Name: admin Oct 03 14:45:40.931974 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: method: > Oct 03 14:45:40.931974 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: exception: Flavor 42 could not be found. Oct 03 14:45:40.931974 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: action_args: {'id': '42'} Oct 03 14:45:40.931974 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:45:40.931974 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:40.932921 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 03 14:45:40.932921 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 03 14:45:40.932921 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 14:45:40.932921 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 14:45:40.932921 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:45:40.932921 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:45:40.932921 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 14:45:40.932921 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 14:45:40.932921 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 14:45:40.932921 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:45:40.932921 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 14:45:40.932921 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 14:45:40.932921 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 03 14:45:40.932921 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi Oct 03 14:45:40.932921 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:45:40.932921 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi Oct 03 14:45:40.932921 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:40.932921 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:45:40.932921 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:45:40.934268 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:45:40.934268 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:45:40.934268 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:45:40.934268 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:45:40.934268 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 03 14:45:40.934268 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:45:40.934268 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 03 14:45:40.934268 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi Oct 03 14:45:40.934268 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:45:40.934268 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi Oct 03 14:45:40.934268 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:40.934268 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:45:40.934268 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:45:40.934268 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:45:40.934268 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:45:40.934268 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 03 14:45:40.934268 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi Oct 03 14:45:40.934268 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-62bf1fe8-8044-4fb4-8590-239e4b6cd52b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:45:40.935540 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-62bf1fe8-8044-4fb4-8590-239e4b6cd52b admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013873 Oct 03 14:45:40.935540 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 22/42] 10.222.0.46 () {60 vars in 1190 bytes} [Mon Oct 3 14:45:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 03 14:45:42.146946 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-23b8797b-3f59-48b6-8ad5-9ae196ee4c64 admin admin] Calling method '>' {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:42.147972 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.requestlog [None req-23b8797b-3f59-48b6-8ad5-9ae196ee4c64 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Oct 03 14:45:42.148353 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: [pid: 111843|app: 0|req: 21/43] 10.222.0.46 () {56 vars in 1074 bytes} [Mon Oct 3 14:45:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:45:42.665042 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-4ed932e9-c2ec-45f8-b1c5-da88d9987b68 admin admin] Calling method '>' {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:42.670102 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.wsgi [None req-4ed932e9-c2ec-45f8-b1c5-da88d9987b68 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 03 14:45:42.671584 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-4ed932e9-c2ec-45f8-b1c5-da88d9987b68 admin admin] Request method failure captured: Oct 03 14:45:42.671584 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 03 14:45:42.671584 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: Accept: application/json Oct 03 14:45:42.671584 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: Accept-Encoding: gzip, deflate Oct 03 14:45:42.671584 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: Connection: keep-alive Oct 03 14:45:42.671584 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: Content-Length: 0 Oct 03 14:45:42.671584 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: Host: 10.222.0.46 Oct 03 14:45:42.671584 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: Openstack-Api-Version: compute 2.92 Oct 03 14:45:42.671584 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: Openstack-System-Scope: None Oct 03 14:45:42.671584 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: User-Agent: python-novaclient Oct 03 14:45:42.671584 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Auth-Token: gAAAAABjOvWWgQllwYzYnPX50XodEjyLxc1cTcjbGvoUVpNdh6GS6jYBes0mecg25-uQF0xon25QbMY2AoieZvR2Gk2RggEDcqMRIVuf72IkKKXEvpWrVwCIWZI9xOYanj6XClauhP9q2JsbkUspWejTe-PICXfgWO9sAkmXYEgCH1rdND5vTns Oct 03 14:45:42.671584 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Domain-Id: None Oct 03 14:45:42.671584 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Domain-Name: None Oct 03 14:45:42.671584 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Identity-Status: Confirmed Oct 03 14:45:42.671584 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Is-Admin-Project: True Oct 03 14:45:42.671584 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Openstack-Nova-Api-Version: 2.92 Oct 03 14:45:42.671584 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Project-Domain-Id: default Oct 03 14:45:42.671584 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Project-Domain-Name: Default Oct 03 14:45:42.671584 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Project-Id: 47484d92809b4b9a846447c512be0a94 Oct 03 14:45:42.671584 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Project-Name: admin Oct 03 14:45:42.671584 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Role: admin,member,reader Oct 03 14:45:42.671584 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Roles: admin,member,reader Oct 03 14:45:42.673627 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/47484d92809b4b9a846447c512be0a94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_47484d92809b4b9a846447c512be0a94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/47484d92809b4b9a846447c512be0a94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/47484d92809b4b9a846447c512be0a94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 14:45:42.673627 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Tenant: admin Oct 03 14:45:42.673627 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Tenant-Id: 47484d92809b4b9a846447c512be0a94 Oct 03 14:45:42.673627 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Tenant-Name: admin Oct 03 14:45:42.673627 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-User: admin Oct 03 14:45:42.673627 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-User-Domain-Id: default Oct 03 14:45:42.673627 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-User-Domain-Name: Default Oct 03 14:45:42.673627 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-User-Id: dd9397aad94548f284667a53c0b499d2 Oct 03 14:45:42.673627 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-User-Name: admin Oct 03 14:45:42.673627 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: method: > Oct 03 14:45:42.673627 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: exception: Flavor 84 could not be found. Oct 03 14:45:42.673627 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: action_args: {'id': '84'} Oct 03 14:45:42.673627 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:45:42.673627 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:42.674580 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 03 14:45:42.674580 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 03 14:45:42.674580 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 14:45:42.674580 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 14:45:42.674580 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:45:42.674580 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:45:42.674580 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 14:45:42.674580 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 14:45:42.674580 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 14:45:42.674580 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:45:42.674580 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 14:45:42.674580 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 14:45:42.674580 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 03 14:45:42.674580 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi Oct 03 14:45:42.674580 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:45:42.674580 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi Oct 03 14:45:42.674580 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:42.674580 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:45:42.674580 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:45:42.676021 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:45:42.676021 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:45:42.676021 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:45:42.676021 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:45:42.676021 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 03 14:45:42.676021 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:45:42.676021 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 03 14:45:42.676021 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi Oct 03 14:45:42.676021 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:45:42.676021 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi Oct 03 14:45:42.676021 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:42.676021 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:45:42.676021 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:45:42.676021 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:45:42.676021 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:45:42.676021 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 03 14:45:42.676021 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi Oct 03 14:45:42.676021 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-4ed932e9-c2ec-45f8-b1c5-da88d9987b68 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:45:42.677257 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-4ed932e9-c2ec-45f8-b1c5-da88d9987b68 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.388405 Oct 03 14:45:42.677257 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 23/44] 10.222.0.46 () {60 vars in 1190 bytes} [Mon Oct 3 14:45:42 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 03 14:45:42.683160 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-550eeaac-cd52-491e-b78a-3f8bcfc9e27e admin admin] Calling method '>' {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:42.698539 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.requestlog [None req-550eeaac-cd52-491e-b78a-3f8bcfc9e27e admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018880 Oct 03 14:45:42.699009 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: [pid: 111843|app: 0|req: 22/45] 10.222.0.46 () {60 vars in 1210 bytes} [Mon Oct 3 14:45:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:45:42.708100 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-a890b29f-a509-4c02-89bd-972f368996f5 admin admin] Calling method '>' {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:42.723211 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-a890b29f-a509-4c02-89bd-972f368996f5 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018644 Oct 03 14:45:42.723752 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 24/46] 10.222.0.46 () {60 vars in 1210 bytes} [Mon Oct 3 14:45:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:45:42.732838 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-90976a53-2f99-405b-8bef-007a8cf6f774 admin admin] Calling method '>' {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:42.738227 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.wsgi [None req-90976a53-2f99-405b-8bef-007a8cf6f774 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 03 14:45:42.739724 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-90976a53-2f99-405b-8bef-007a8cf6f774 admin admin] Request method failure captured: Oct 03 14:45:42.739724 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 03 14:45:42.739724 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: Accept: application/json Oct 03 14:45:42.739724 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: Accept-Encoding: gzip, deflate Oct 03 14:45:42.739724 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: Connection: keep-alive Oct 03 14:45:42.739724 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: Content-Length: 0 Oct 03 14:45:42.739724 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: Host: 10.222.0.46 Oct 03 14:45:42.739724 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: Openstack-Api-Version: compute 2.92 Oct 03 14:45:42.739724 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: Openstack-System-Scope: None Oct 03 14:45:42.739724 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: User-Agent: python-novaclient Oct 03 14:45:42.739724 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Auth-Token: gAAAAABjOvWWgQllwYzYnPX50XodEjyLxc1cTcjbGvoUVpNdh6GS6jYBes0mecg25-uQF0xon25QbMY2AoieZvR2Gk2RggEDcqMRIVuf72IkKKXEvpWrVwCIWZI9xOYanj6XClauhP9q2JsbkUspWejTe-PICXfgWO9sAkmXYEgCH1rdND5vTns Oct 03 14:45:42.739724 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Domain-Id: None Oct 03 14:45:42.739724 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Domain-Name: None Oct 03 14:45:42.739724 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Identity-Status: Confirmed Oct 03 14:45:42.739724 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Is-Admin-Project: True Oct 03 14:45:42.739724 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Openstack-Nova-Api-Version: 2.92 Oct 03 14:45:42.739724 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Project-Domain-Id: default Oct 03 14:45:42.739724 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Project-Domain-Name: Default Oct 03 14:45:42.739724 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Project-Id: 47484d92809b4b9a846447c512be0a94 Oct 03 14:45:42.739724 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Project-Name: admin Oct 03 14:45:42.739724 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Role: admin,member,reader Oct 03 14:45:42.739724 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Roles: admin,member,reader Oct 03 14:45:42.741265 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/47484d92809b4b9a846447c512be0a94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_47484d92809b4b9a846447c512be0a94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/47484d92809b4b9a846447c512be0a94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/47484d92809b4b9a846447c512be0a94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 14:45:42.741265 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Tenant: admin Oct 03 14:45:42.741265 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Tenant-Id: 47484d92809b4b9a846447c512be0a94 Oct 03 14:45:42.741265 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Tenant-Name: admin Oct 03 14:45:42.741265 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-User: admin Oct 03 14:45:42.741265 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-User-Domain-Id: default Oct 03 14:45:42.741265 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-User-Domain-Name: Default Oct 03 14:45:42.741265 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-User-Id: dd9397aad94548f284667a53c0b499d2 Oct 03 14:45:42.741265 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-User-Name: admin Oct 03 14:45:42.741265 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: method: > Oct 03 14:45:42.741265 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: exception: Flavor 84 could not be found. Oct 03 14:45:42.741265 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: action_args: {'id': '84'} Oct 03 14:45:42.741265 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:45:42.741265 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:42.742511 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 03 14:45:42.742511 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 03 14:45:42.742511 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 14:45:42.742511 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 14:45:42.742511 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:45:42.742511 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:45:42.742511 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 14:45:42.742511 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 14:45:42.742511 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 14:45:42.742511 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:45:42.742511 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 14:45:42.742511 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 14:45:42.742511 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 03 14:45:42.742511 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi Oct 03 14:45:42.742511 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:45:42.742511 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi Oct 03 14:45:42.742511 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:42.742511 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:45:42.742511 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:45:42.743810 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:45:42.743810 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:45:42.743810 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:45:42.743810 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:45:42.743810 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 03 14:45:42.743810 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:45:42.743810 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 03 14:45:42.743810 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi Oct 03 14:45:42.743810 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:45:42.743810 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi Oct 03 14:45:42.743810 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:42.743810 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:45:42.743810 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:45:42.743810 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:45:42.743810 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:45:42.743810 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 03 14:45:42.743810 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi Oct 03 14:45:42.743810 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-90976a53-2f99-405b-8bef-007a8cf6f774 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:45:42.745143 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.requestlog [None req-90976a53-2f99-405b-8bef-007a8cf6f774 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011631 Oct 03 14:45:42.745143 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: [pid: 111843|app: 0|req: 23/47] 10.222.0.46 () {60 vars in 1190 bytes} [Mon Oct 3 14:45:42 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 03 14:45:43.952050 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-a890b29f-a509-4c02-89bd-972f368996f5 admin admin] Calling method '>' {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:43.953629 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-a890b29f-a509-4c02-89bd-972f368996f5 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Oct 03 14:45:43.954059 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 25/48] 10.222.0.46 () {56 vars in 1074 bytes} [Mon Oct 3 14:45:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:44.472316 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-154defa4-27ab-42c2-b13b-89eacd28c60e admin admin] Calling method '>' {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:44.478369 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.wsgi [None req-154defa4-27ab-42c2-b13b-89eacd28c60e admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 03 14:45:44.480124 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-154defa4-27ab-42c2-b13b-89eacd28c60e admin admin] Request method failure captured: Oct 03 14:45:44.480124 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 03 14:45:44.480124 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: Accept: application/json Oct 03 14:45:44.480124 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: Accept-Encoding: gzip, deflate Oct 03 14:45:44.480124 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: Connection: keep-alive Oct 03 14:45:44.480124 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: Content-Length: 0 Oct 03 14:45:44.480124 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: Host: 10.222.0.46 Oct 03 14:45:44.480124 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: Openstack-Api-Version: compute 2.92 Oct 03 14:45:44.480124 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: Openstack-System-Scope: None Oct 03 14:45:44.480124 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: User-Agent: python-novaclient Oct 03 14:45:44.480124 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Auth-Token: gAAAAABjOvWX8v95ZpfiZjBMSckT1ejv30Kg2UBkDlCZCDKamASfBO4Mfxbmdms3bEAY94Cdk1WaQxpDNeB0lpjt4CjjPjlvYQ2l0ZQuKcabsJJ7dTqelLtKg9Y1euBnS5m91N1SkqXim-UsrrYMtIoqYrGv3lliS1LqVLfFu8OuIztQALw0iSY Oct 03 14:45:44.480124 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Domain-Id: None Oct 03 14:45:44.480124 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Domain-Name: None Oct 03 14:45:44.480124 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Identity-Status: Confirmed Oct 03 14:45:44.480124 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Is-Admin-Project: True Oct 03 14:45:44.480124 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Openstack-Nova-Api-Version: 2.92 Oct 03 14:45:44.480124 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Project-Domain-Id: default Oct 03 14:45:44.480124 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Project-Domain-Name: Default Oct 03 14:45:44.480124 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Project-Id: 47484d92809b4b9a846447c512be0a94 Oct 03 14:45:44.480124 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Project-Name: admin Oct 03 14:45:44.480124 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Role: admin,member,reader Oct 03 14:45:44.480124 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Roles: admin,member,reader Oct 03 14:45:44.481659 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/47484d92809b4b9a846447c512be0a94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_47484d92809b4b9a846447c512be0a94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/47484d92809b4b9a846447c512be0a94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/47484d92809b4b9a846447c512be0a94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 14:45:44.481659 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Tenant: admin Oct 03 14:45:44.481659 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Tenant-Id: 47484d92809b4b9a846447c512be0a94 Oct 03 14:45:44.481659 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-Tenant-Name: admin Oct 03 14:45:44.481659 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-User: admin Oct 03 14:45:44.481659 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-User-Domain-Id: default Oct 03 14:45:44.481659 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-User-Domain-Name: Default Oct 03 14:45:44.481659 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-User-Id: dd9397aad94548f284667a53c0b499d2 Oct 03 14:45:44.481659 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: X-User-Name: admin Oct 03 14:45:44.481659 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: method: > Oct 03 14:45:44.481659 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: exception: Flavor 451 could not be found. Oct 03 14:45:44.481659 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: action_args: {'id': '451'} Oct 03 14:45:44.481659 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:45:44.481659 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:44.482649 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 03 14:45:44.482649 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 03 14:45:44.482649 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 14:45:44.482649 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 14:45:44.482649 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:45:44.482649 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:45:44.482649 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 14:45:44.482649 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 14:45:44.482649 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 14:45:44.482649 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:45:44.482649 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 14:45:44.482649 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 14:45:44.482649 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 03 14:45:44.482649 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi Oct 03 14:45:44.482649 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:45:44.482649 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi Oct 03 14:45:44.482649 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:44.482649 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:45:44.482649 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:45:44.483910 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:45:44.483910 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:45:44.483910 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:45:44.483910 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:45:44.483910 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 03 14:45:44.483910 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:45:44.483910 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 03 14:45:44.483910 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi Oct 03 14:45:44.483910 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:45:44.483910 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi Oct 03 14:45:44.483910 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:44.483910 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:45:44.483910 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:45:44.483910 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:45:44.483910 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:45:44.483910 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 03 14:45:44.483910 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: ERROR nova.api.openstack.wsgi Oct 03 14:45:44.483910 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-154defa4-27ab-42c2-b13b-89eacd28c60e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:45:44.485164 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.requestlog [None req-154defa4-27ab-42c2-b13b-89eacd28c60e admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.391256 Oct 03 14:45:44.485164 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: [pid: 111843|app: 0|req: 24/49] 10.222.0.46 () {60 vars in 1193 bytes} [Mon Oct 3 14:45:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 03 14:45:44.491200 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-a0b5f22b-04ce-4ecc-913e-12c1a7a937f7 admin admin] Calling method '>' {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:44.506843 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-a0b5f22b-04ce-4ecc-913e-12c1a7a937f7 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019227 Oct 03 14:45:44.507369 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 26/50] 10.222.0.46 () {60 vars in 1210 bytes} [Mon Oct 3 14:45:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:45:44.517232 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-06fc50bf-f72c-4911-beac-32a1ce6a1161 admin admin] Calling method '>' {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:44.531882 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.requestlog [None req-06fc50bf-f72c-4911-beac-32a1ce6a1161 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018779 Oct 03 14:45:44.532401 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: [pid: 111843|app: 0|req: 25/51] 10.222.0.46 () {60 vars in 1210 bytes} [Mon Oct 3 14:45:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:45:44.541237 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-d58e3ccf-d164-4271-8968-492646373390 admin admin] Calling method '>' {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:44.546219 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.wsgi [None req-d58e3ccf-d164-4271-8968-492646373390 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 03 14:45:44.547710 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-d58e3ccf-d164-4271-8968-492646373390 admin admin] Request method failure captured: Oct 03 14:45:44.547710 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 03 14:45:44.547710 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: Accept: application/json Oct 03 14:45:44.547710 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: Accept-Encoding: gzip, deflate Oct 03 14:45:44.547710 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: Connection: keep-alive Oct 03 14:45:44.547710 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: Content-Length: 0 Oct 03 14:45:44.547710 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: Host: 10.222.0.46 Oct 03 14:45:44.547710 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: Openstack-Api-Version: compute 2.92 Oct 03 14:45:44.547710 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: Openstack-System-Scope: None Oct 03 14:45:44.547710 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: User-Agent: python-novaclient Oct 03 14:45:44.547710 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Auth-Token: gAAAAABjOvWX8v95ZpfiZjBMSckT1ejv30Kg2UBkDlCZCDKamASfBO4Mfxbmdms3bEAY94Cdk1WaQxpDNeB0lpjt4CjjPjlvYQ2l0ZQuKcabsJJ7dTqelLtKg9Y1euBnS5m91N1SkqXim-UsrrYMtIoqYrGv3lliS1LqVLfFu8OuIztQALw0iSY Oct 03 14:45:44.547710 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Domain-Id: None Oct 03 14:45:44.547710 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Domain-Name: None Oct 03 14:45:44.547710 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Identity-Status: Confirmed Oct 03 14:45:44.547710 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Is-Admin-Project: True Oct 03 14:45:44.547710 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Openstack-Nova-Api-Version: 2.92 Oct 03 14:45:44.547710 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Project-Domain-Id: default Oct 03 14:45:44.547710 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Project-Domain-Name: Default Oct 03 14:45:44.547710 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Project-Id: 47484d92809b4b9a846447c512be0a94 Oct 03 14:45:44.547710 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Project-Name: admin Oct 03 14:45:44.547710 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Role: admin,member,reader Oct 03 14:45:44.547710 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Roles: admin,member,reader Oct 03 14:45:44.549232 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/47484d92809b4b9a846447c512be0a94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_47484d92809b4b9a846447c512be0a94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/47484d92809b4b9a846447c512be0a94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/47484d92809b4b9a846447c512be0a94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 14:45:44.549232 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Tenant: admin Oct 03 14:45:44.549232 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Tenant-Id: 47484d92809b4b9a846447c512be0a94 Oct 03 14:45:44.549232 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-Tenant-Name: admin Oct 03 14:45:44.549232 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-User: admin Oct 03 14:45:44.549232 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-User-Domain-Id: default Oct 03 14:45:44.549232 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-User-Domain-Name: Default Oct 03 14:45:44.549232 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-User-Id: dd9397aad94548f284667a53c0b499d2 Oct 03 14:45:44.549232 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: X-User-Name: admin Oct 03 14:45:44.549232 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: method: > Oct 03 14:45:44.549232 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: exception: Flavor 451 could not be found. Oct 03 14:45:44.549232 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: action_args: {'id': '451'} Oct 03 14:45:44.549232 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:45:44.549232 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:44.550401 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 03 14:45:44.550401 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 03 14:45:44.550401 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 14:45:44.550401 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 14:45:44.550401 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:45:44.550401 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:45:44.550401 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 14:45:44.550401 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 14:45:44.550401 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 14:45:44.550401 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:45:44.550401 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 14:45:44.550401 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 14:45:44.550401 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 03 14:45:44.550401 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi Oct 03 14:45:44.550401 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:45:44.550401 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi Oct 03 14:45:44.550401 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:44.550401 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:45:44.550401 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:45:44.551729 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:45:44.551729 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:45:44.551729 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:45:44.551729 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:45:44.551729 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 03 14:45:44.551729 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:45:44.551729 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 03 14:45:44.551729 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi Oct 03 14:45:44.551729 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:45:44.551729 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi Oct 03 14:45:44.551729 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:44.551729 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:45:44.551729 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:45:44.551729 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:45:44.551729 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:45:44.551729 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 03 14:45:44.551729 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: ERROR nova.api.openstack.wsgi Oct 03 14:45:44.551729 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-d58e3ccf-d164-4271-8968-492646373390 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:45:44.553078 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-d58e3ccf-d164-4271-8968-492646373390 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011267 Oct 03 14:45:44.553078 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 27/52] 10.222.0.46 () {60 vars in 1193 bytes} [Mon Oct 3 14:45:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 03 14:45:45.769874 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-06fc50bf-f72c-4911-beac-32a1ce6a1161 admin admin] Calling method '>' {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:45.770893 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.requestlog [None req-06fc50bf-f72c-4911-beac-32a1ce6a1161 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Oct 03 14:45:45.771300 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: [pid: 111843|app: 0|req: 26/53] 10.222.0.46 () {56 vars in 1074 bytes} [Mon Oct 3 14:45:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:46.287720 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-b2b8fa50-7197-4efd-8050-c652b450b7de admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:46.307264 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-b2b8fa50-7197-4efd-8050-c652b450b7de admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.396955 Oct 03 14:45:46.307812 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 28/54] 10.222.0.46 () {64 vars in 1235 bytes} [Mon Oct 3 14:45:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:45:47.634974 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-06fc50bf-f72c-4911-beac-32a1ce6a1161 admin admin] Calling method '>' {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:47.635974 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.requestlog [None req-06fc50bf-f72c-4911-beac-32a1ce6a1161 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Oct 03 14:45:47.636361 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: [pid: 111843|app: 0|req: 27/55] 10.222.0.46 () {56 vars in 1074 bytes} [Mon Oct 3 14:45:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:48.151428 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-3bf4936e-7721-4610-b256-b008351d1d8d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:48.169453 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-3bf4936e-7721-4610-b256-b008351d1d8d admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.397381 Oct 03 14:45:48.170037 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 29/56] 10.222.0.46 () {64 vars in 1235 bytes} [Mon Oct 3 14:45:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:45:49.382466 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-06fc50bf-f72c-4911-beac-32a1ce6a1161 admin admin] Calling method '>' {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:49.387100 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.requestlog [None req-06fc50bf-f72c-4911-beac-32a1ce6a1161 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001558 Oct 03 14:45:49.387100 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: [pid: 111843|app: 0|req: 28/57] 10.222.0.46 () {56 vars in 1074 bytes} [Mon Oct 3 14:45:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:49.896254 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-c1a8b1eb-e6b3-4be7-8724-fc9527eb7dee admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:49.914827 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-c1a8b1eb-e6b3-4be7-8724-fc9527eb7dee admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.394006 Oct 03 14:45:49.915372 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 30/58] 10.222.0.46 () {64 vars in 1235 bytes} [Mon Oct 3 14:45:49 2022] POST /compute/v2.1/flavors => generated 407 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:45:51.122300 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-06fc50bf-f72c-4911-beac-32a1ce6a1161 admin admin] Calling method '>' {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:51.123304 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.requestlog [None req-06fc50bf-f72c-4911-beac-32a1ce6a1161 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 03 14:45:51.123690 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: [pid: 111843|app: 0|req: 29/59] 10.222.0.46 () {56 vars in 1074 bytes} [Mon Oct 3 14:45:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:51.639573 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-e2b96041-1dc6-4add-b236-9c2e0476d9e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:51.658574 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-e2b96041-1dc6-4add-b236-9c2e0476d9e3 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.399413 Oct 03 14:45:51.659101 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 31/60] 10.222.0.46 () {64 vars in 1235 bytes} [Mon Oct 3 14:45:51 2022] POST /compute/v2.1/flavors => generated 409 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:45:52.859668 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-06fc50bf-f72c-4911-beac-32a1ce6a1161 admin admin] Calling method '>' {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:52.860712 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.requestlog [None req-06fc50bf-f72c-4911-beac-32a1ce6a1161 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002063 Oct 03 14:45:52.861399 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: [pid: 111843|app: 0|req: 30/61] 10.222.0.46 () {56 vars in 1074 bytes} [Mon Oct 3 14:45:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:53.378368 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-a2ebbcdb-b6cd-4962-b16a-dd077920d125 admin admin] Calling method '>' {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:53.398734 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-a2ebbcdb-b6cd-4962-b16a-dd077920d125 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.400997 Oct 03 14:45:53.399266 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 32/62] 10.222.0.46 () {60 vars in 1202 bytes} [Mon Oct 3 14:45:52 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:46:49.694142 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-06fc50bf-f72c-4911-beac-32a1ce6a1161 admin admin] Calling method '>' {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:49.695199 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.requestlog [None req-06fc50bf-f72c-4911-beac-32a1ce6a1161 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001616 Oct 03 14:46:49.695599 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: [pid: 111843|app: 0|req: 31/63] 10.222.0.46 () {54 vars in 931 bytes} [Mon Oct 3 14:46:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:46:49.706170 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG dbcounter [-] [111842] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=111842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:50.081241 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-5af0ff5f-a34d-4c03-b1f5-bd5f9eb996ad admin admin] Calling method '>' {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:50.101660 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-5af0ff5f-a34d-4c03-b1f5-bd5f9eb996ad admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.399935 Oct 03 14:46:50.102463 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 33/64] 10.222.0.46 () {60 vars in 1292 bytes} [Mon Oct 3 14:46:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:46:50.122937 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG dbcounter [-] [111843] Writing DB stats nova_api:SELECT=14 {{(pid=111843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:50.126964 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-6f53906b-5e9b-41f9-a8a0-4073330e725f admin admin] Calling method '>' {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:50.134403 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.requestlog [None req-6f53906b-5e9b-41f9-a8a0-4073330e725f admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012919 Oct 03 14:46:50.134928 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: [pid: 111843|app: 0|req: 32/65] 10.222.0.46 () {60 vars in 1283 bytes} [Mon Oct 3 14:46:50 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:46:50.146629 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-91dc8c8f-bf19-4528-a644-6500fbce2966 admin admin] Calling method '>' {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:50.154356 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-91dc8c8f-bf19-4528-a644-6500fbce2966 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011174 Oct 03 14:46:50.154856 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 34/66] 10.222.0.46 () {60 vars in 1286 bytes} [Mon Oct 3 14:46:50 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:50.165874 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-77332af5-d65b-484c-abb2-5223005c1e8c admin admin] Calling method '>' {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:50.172844 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.requestlog [None req-77332af5-d65b-484c-abb2-5223005c1e8c admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010379 Oct 03 14:46:50.173346 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: [pid: 111843|app: 0|req: 33/67] 10.222.0.46 () {60 vars in 1286 bytes} [Mon Oct 3 14:46:50 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:50.184173 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-79327b39-9f97-4790-aac4-d7a50fa36ea5 admin admin] Calling method '>' {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:50.191145 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-79327b39-9f97-4790-aac4-d7a50fa36ea5 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010393 Oct 03 14:46:50.191646 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 35/68] 10.222.0.46 () {60 vars in 1283 bytes} [Mon Oct 3 14:46:50 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:49:52.667913 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-77332af5-d65b-484c-abb2-5223005c1e8c admin admin] Calling method '>' {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:52.668926 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.requestlog [None req-77332af5-d65b-484c-abb2-5223005c1e8c admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Oct 03 14:49:52.669329 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: [pid: 111843|app: 0|req: 34/69] 10.222.0.46 () {56 vars in 1074 bytes} [Mon Oct 3 14:49:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:49:52.808970 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG dbcounter [-] [111842] Writing DB stats nova_api:SELECT=6 {{(pid=111842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:49:52.967047 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-155088f9-057b-4602-9369-ec757154c095 admin admin] Calling method '>' {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:52.971660 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG oslo_concurrency.lockutils [None req-155088f9-057b-4602-9369-ec757154c095 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:52.972130 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG oslo_concurrency.lockutils [None req-155088f9-057b-4602-9369-ec757154c095 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:52.972806 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG oslo_concurrency.lockutils [None req-155088f9-057b-4602-9369-ec757154c095 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:52.973628 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG oslo_concurrency.lockutils [None req-155088f9-057b-4602-9369-ec757154c095 admin admin] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:52.974072 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG oslo_concurrency.lockutils [None req-155088f9-057b-4602-9369-ec757154c095 admin admin] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:52.974487 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG oslo_concurrency.lockutils [None req-155088f9-057b-4602-9369-ec757154c095 admin admin] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:53.006134 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-155088f9-057b-4602-9369-ec757154c095 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.198467 Oct 03 14:49:53.006671 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 36/70] 10.222.0.46 () {60 vars in 1193 bytes} [Mon Oct 3 14:49:52 2022] GET /compute/v2.1/os-services => generated 791 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:49:54.077437 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-77332af5-d65b-484c-abb2-5223005c1e8c admin admin] Calling method '>' {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:54.078611 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.requestlog [None req-77332af5-d65b-484c-abb2-5223005c1e8c admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Oct 03 14:49:54.079001 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: [pid: 111843|app: 0|req: 35/71] 10.222.0.46 () {56 vars in 1074 bytes} [Mon Oct 3 14:49:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:49:54.269005 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-57459e8e-3eb1-4adb-8667-697af44c4e1d admin admin] Calling method '>' {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:54.273078 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG oslo_concurrency.lockutils [None req-57459e8e-3eb1-4adb-8667-697af44c4e1d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:54.273945 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG oslo_concurrency.lockutils [None req-57459e8e-3eb1-4adb-8667-697af44c4e1d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:54.274409 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG oslo_concurrency.lockutils [None req-57459e8e-3eb1-4adb-8667-697af44c4e1d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=111842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:54.275356 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG oslo_concurrency.lockutils [None req-57459e8e-3eb1-4adb-8667-697af44c4e1d admin admin] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:54.275885 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG oslo_concurrency.lockutils [None req-57459e8e-3eb1-4adb-8667-697af44c4e1d admin admin] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:54.276311 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG oslo_concurrency.lockutils [None req-57459e8e-3eb1-4adb-8667-697af44c4e1d admin admin] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:54.298802 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-57459e8e-3eb1-4adb-8667-697af44c4e1d admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.081600 Oct 03 14:49:54.299379 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 37/72] 10.222.0.46 () {60 vars in 1193 bytes} [Mon Oct 3 14:49:54 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:50:05.801457 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-77332af5-d65b-484c-abb2-5223005c1e8c admin admin] Calling method '>' {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:05.803027 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.requestlog [None req-77332af5-d65b-484c-abb2-5223005c1e8c admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001984 Oct 03 14:50:05.803422 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: [pid: 111843|app: 0|req: 36/73] 10.222.0.46 () {56 vars in 1074 bytes} [Mon Oct 3 14:50:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:50:05.945765 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG dbcounter [-] [111842] Writing DB stats nova_cell0:SELECT=4 {{(pid=111842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:50:05.946471 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG dbcounter [-] [111842] Writing DB stats nova_cell1:SELECT=4 {{(pid=111842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:50:05.947145 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG dbcounter [-] [111842] Writing DB stats nova_api:SELECT=8 {{(pid=111842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:50:05.995443 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-9b4d5098-36d1-450e-aad1-5b52e29e19a0 admin admin] Calling method '>' {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:05.998919 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG oslo_concurrency.lockutils [None req-9b4d5098-36d1-450e-aad1-5b52e29e19a0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:05.999397 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG oslo_concurrency.lockutils [None req-9b4d5098-36d1-450e-aad1-5b52e29e19a0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:05.999826 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG oslo_concurrency.lockutils [None req-9b4d5098-36d1-450e-aad1-5b52e29e19a0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:06.000561 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG oslo_concurrency.lockutils [None req-9b4d5098-36d1-450e-aad1-5b52e29e19a0 admin admin] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:06.001008 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG oslo_concurrency.lockutils [None req-9b4d5098-36d1-450e-aad1-5b52e29e19a0 admin admin] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:06.001422 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG oslo_concurrency.lockutils [None req-9b4d5098-36d1-450e-aad1-5b52e29e19a0 admin admin] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:06.025713 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-9b4d5098-36d1-450e-aad1-5b52e29e19a0 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.084242 Oct 03 14:50:06.026257 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 38/74] 10.222.0.46 () {60 vars in 1193 bytes} [Mon Oct 3 14:50:05 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:50:07.105663 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG nova.api.openstack.wsgi [None req-77332af5-d65b-484c-abb2-5223005c1e8c admin admin] Calling method '>' {{(pid=111843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:07.106684 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: INFO nova.api.openstack.requestlog [None req-77332af5-d65b-484c-abb2-5223005c1e8c admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Oct 03 14:50:07.107085 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: [pid: 111843|app: 0|req: 37/75] 10.222.0.46 () {56 vars in 1074 bytes} [Mon Oct 3 14:50:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:50:07.302800 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG nova.api.openstack.wsgi [None req-6bea7b4e-92e8-408f-8570-bfece477d44d admin admin] Calling method '>' {{(pid=111842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:07.306221 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG oslo_concurrency.lockutils [None req-6bea7b4e-92e8-408f-8570-bfece477d44d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:07.306694 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG oslo_concurrency.lockutils [None req-6bea7b4e-92e8-408f-8570-bfece477d44d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:07.307125 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG oslo_concurrency.lockutils [None req-6bea7b4e-92e8-408f-8570-bfece477d44d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:07.307832 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG oslo_concurrency.lockutils [None req-6bea7b4e-92e8-408f-8570-bfece477d44d admin admin] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:07.308273 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG oslo_concurrency.lockutils [None req-6bea7b4e-92e8-408f-8570-bfece477d44d admin admin] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:07.308683 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: DEBUG oslo_concurrency.lockutils [None req-6bea7b4e-92e8-408f-8570-bfece477d44d admin admin] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:07.329833 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: INFO nova.api.openstack.requestlog [None req-6bea7b4e-92e8-408f-8570-bfece477d44d admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.085172 Oct 03 14:50:07.330319 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: [pid: 111842|app: 0|req: 39/76] 10.222.0.46 () {60 vars in 1193 bytes} [Mon Oct 3 14:50:07 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:51:04.566113 dv-cinder-859877-2-iscsi devstack@n-api.service[111841]: Mon Oct 3 14:51:04 2022 - graceful shutdown triggered... Oct 03 14:51:04.566585 dv-cinder-859877-2-iscsi devstack@n-api.service[111842]: Gracefully killing worker 1 (pid: 111842)... Oct 03 14:51:04.566236 dv-cinder-859877-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 03 14:51:04.567377 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: Gracefully killing worker 2 (pid: 111843)... Oct 03 14:51:04.696435 dv-cinder-859877-2-iscsi devstack@n-api.service[111843]: DEBUG dbcounter [-] [111843] Writing DB stats nova_api:SELECT=4 {{(pid=111843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:51:05.566803 dv-cinder-859877-2-iscsi devstack@n-api.service[111841]: worker 1 buried after 1 seconds Oct 03 14:51:05.566803 dv-cinder-859877-2-iscsi devstack@n-api.service[111841]: worker 2 buried after 1 seconds Oct 03 14:51:05.566803 dv-cinder-859877-2-iscsi devstack@n-api.service[111841]: goodbye to uWSGI. Oct 03 14:51:05.568335 dv-cinder-859877-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 03 14:51:05.568876 dv-cinder-859877-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 03 14:51:05.571656 dv-cinder-859877-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 03 14:51:05.583336 dv-cinder-859877-2-iscsi devstack@n-api.service[126837]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 03 14:51:05.585881 dv-cinder-859877-2-iscsi devstack@n-api.service[126837]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 3 14:51:05 2022] *** Oct 03 14:51:05.585881 dv-cinder-859877-2-iscsi devstack@n-api.service[126837]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 03 14:51:05.585881 dv-cinder-859877-2-iscsi devstack@n-api.service[126837]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 03 14:51:05.585881 dv-cinder-859877-2-iscsi devstack@n-api.service[126837]: nodename: dv-cinder-859877-2-iscsi Oct 03 14:51:05.585881 dv-cinder-859877-2-iscsi devstack@n-api.service[126837]: machine: x86_64 Oct 03 14:51:05.585881 dv-cinder-859877-2-iscsi devstack@n-api.service[126837]: clock source: unix Oct 03 14:51:05.585881 dv-cinder-859877-2-iscsi devstack@n-api.service[126837]: pcre jit disabled Oct 03 14:51:05.585881 dv-cinder-859877-2-iscsi devstack@n-api.service[126837]: detected number of CPU cores: 4 Oct 03 14:51:05.585881 dv-cinder-859877-2-iscsi devstack@n-api.service[126837]: current working directory: / Oct 03 14:51:05.585881 dv-cinder-859877-2-iscsi devstack@n-api.service[126837]: detected binary path: /usr/bin/uwsgi-core Oct 03 14:51:05.585881 dv-cinder-859877-2-iscsi devstack@n-api.service[126837]: your processes number limit is 47680 Oct 03 14:51:05.586739 dv-cinder-859877-2-iscsi devstack@n-api.service[126837]: your memory page size is 4096 bytes Oct 03 14:51:05.586739 dv-cinder-859877-2-iscsi devstack@n-api.service[126837]: detected max file descriptor number: 2048 Oct 03 14:51:05.586739 dv-cinder-859877-2-iscsi devstack@n-api.service[126837]: lock engine: pthread robust mutexes Oct 03 14:51:05.586739 dv-cinder-859877-2-iscsi devstack@n-api.service[126837]: thunder lock: enabled Oct 03 14:51:05.586739 dv-cinder-859877-2-iscsi devstack@n-api.service[126837]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 03 14:51:05.586739 dv-cinder-859877-2-iscsi devstack@n-api.service[126837]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 03 14:51:05.626307 dv-cinder-859877-2-iscsi devstack@n-api.service[126837]: Python main interpreter initialized at 0x558f0b5f69c0 Oct 03 14:51:05.626307 dv-cinder-859877-2-iscsi devstack@n-api.service[126837]: python threads support enabled Oct 03 14:51:05.626307 dv-cinder-859877-2-iscsi devstack@n-api.service[126837]: your server socket listen backlog is limited to 100 connections Oct 03 14:51:05.626307 dv-cinder-859877-2-iscsi devstack@n-api.service[126837]: your mercy for graceful operations on workers is 90 seconds Oct 03 14:51:05.626720 dv-cinder-859877-2-iscsi devstack@n-api.service[126837]: mapped 403077 bytes (393 KB) for 2 cores Oct 03 14:51:05.626796 dv-cinder-859877-2-iscsi devstack@n-api.service[126837]: *** Operational MODE: preforking *** Oct 03 14:51:05.627035 dv-cinder-859877-2-iscsi devstack@n-api.service[126837]: *** uWSGI is running in multiple interpreter mode *** Oct 03 14:51:05.627035 dv-cinder-859877-2-iscsi devstack@n-api.service[126837]: spawned uWSGI master process (pid: 126837) Oct 03 14:51:05.627241 dv-cinder-859877-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 03 14:51:05.627828 dv-cinder-859877-2-iscsi devstack@n-api.service[126837]: spawned uWSGI worker 1 (pid: 126851, cores: 1) Oct 03 14:51:05.628379 dv-cinder-859877-2-iscsi devstack@n-api.service[126837]: spawned uWSGI worker 2 (pid: 126852, cores: 1) Oct 03 14:51:05.628694 dv-cinder-859877-2-iscsi devstack@n-api.service[126837]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 03 14:51:06.289017 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 03 14:51:06.289841 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 03 14:51:07.455194 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 14:51:07.455194 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: from cryptography.utils import int_from_bytes Oct 03 14:51:07.455881 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 14:51:07.455881 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: from cryptography.utils import int_from_bytes Oct 03 14:51:07.455881 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 14:51:07.455881 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: from cryptography.utils import int_from_bytes Oct 03 14:51:07.456416 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 14:51:07.456416 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: from cryptography.utils import int_from_bytes Oct 03 14:51:09.860528 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 03 14:51:09.861070 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 03 14:51:09.861350 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 03 14:51:09.861625 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 03 14:51:09.861886 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 03 14:51:09.862277 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.862604 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.862927 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.863246 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.863524 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 03 14:51:09.863895 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.864002 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 03 14:51:09.864081 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.864182 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.864372 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 03 14:51:09.864474 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.864679 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 03 14:51:09.864797 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.864962 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 03 14:51:09.865062 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.865327 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.865447 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.865729 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.865937 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859877-2-iscsi {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.866035 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.866225 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.866387 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.866550 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.866710 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.866876 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.867035 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.867194 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.867361 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.867526 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.867692 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.867838 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.867981 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.868124 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.868295 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.868522 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.868681 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.869001 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859877-2-iscsi {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.869352 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.869697 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.870019 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.870351 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.870565 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.870727 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.870976 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.871132 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.871291 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.871699 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.871857 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.872101 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.872296 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.872466 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.872717 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.872874 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.873059 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.873383 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.873581 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.873750 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.873998 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.874155 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.874350 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.874497 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.874650 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.874954 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.875115 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.875265 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.875435 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859877-2-iscsi {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.875667 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.875852 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859877-2-iscsi {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.876046 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.876203 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.876354 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.876497 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.876803 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.876961 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.877106 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.877264 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.877412 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.877593 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.877758 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.877902 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.878045 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.878195 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.878350 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.878504 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.878658 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.878819 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.878969 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.879120 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.879263 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.879567 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.879755 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.880055 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.880215 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.880385 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.880716 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.880877 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.881023 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.881690 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.881961 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.882125 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.882280 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.882439 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.882590 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.882590 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.882980 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.883133 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.883275 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.883275 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.883619 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.883763 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.884004 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.884152 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.884309 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.884458 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.884610 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.884610 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.884905 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.884905 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.885201 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.885344 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.885527 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.885678 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.885914 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.886126 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.886287 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.886431 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.886584 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.886727 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.887043 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.887211 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.887359 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.887509 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.887661 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.887954 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.888114 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.888259 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.888408 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.888559 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.888703 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.888853 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.889006 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.889197 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.889352 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.889718 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.889874 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.890182 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.890354 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.890499 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.890650 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.891009 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.891160 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.891305 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.891461 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.891604 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.891746 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.891889 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.892032 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.892190 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.892354 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.892508 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.892659 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.892802 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.892951 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.893103 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.893258 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.893403 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.893571 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.893732 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.893883 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.894035 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.894185 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.894347 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.894502 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.894653 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.894811 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.895039 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.895191 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.895336 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.895479 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.895629 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.895782 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.895942 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.896134 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.896325 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.896484 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.896627 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.897662 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.897843 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.898082 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.898242 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.898387 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.898540 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.898696 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.898847 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.899002 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.899153 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.899297 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.899450 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.899605 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.899915 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.900066 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.900372 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.900531 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.900683 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.900838 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.901179 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.901338 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.901482 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.901682 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.901858 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.902003 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.902146 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.902296 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.902447 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.905016 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.905187 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.905341 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.905545 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.905715 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.905872 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.906031 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.906186 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.906412 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.906570 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.906723 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.906873 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.907019 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.907173 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.907326 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.907488 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.907650 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.907934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.908102 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.908325 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.908482 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.908645 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.908790 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.908934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.909094 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.909247 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.909391 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.909569 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.909729 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.910043 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.910220 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.910930 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.911030 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.911106 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.911179 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.911261 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.911345 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.911424 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.911502 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.911572 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.911641 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.911715 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.911802 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.911881 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.911958 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.912033 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.912110 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.912186 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.912270 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.912369 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.912445 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.912527 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.912597 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.912682 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.912767 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.912844 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.912936 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.913018 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.913101 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.913194 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.913278 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.913368 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.913459 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.913567 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.913667 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.913770 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.913862 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.913945 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:51:09.914033 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.914119 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.914209 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.914305 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.914305 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.914466 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.914555 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.914637 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.914727 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.914811 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.914898 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.914987 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.915076 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.915165 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.915256 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.915347 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.915437 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.915437 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.915594 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.915682 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.915773 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.915855 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.915943 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.916031 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.916114 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.916203 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.916298 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.916398 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.916487 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.916576 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.916658 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.916745 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.916835 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.916926 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.917015 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.925667 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.925846 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.926013 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.926175 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.926329 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.926527 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.926687 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.926843 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.927051 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.927224 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.927377 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.929216 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.929387 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.929594 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.929758 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.929916 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.930072 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.930382 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.930533 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.930698 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.930842 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.931145 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.931299 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.931444 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.931588 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.931732 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.931891 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.932044 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.932190 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.932333 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.932485 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.932628 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.932990 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.933142 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.933287 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.933430 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.933595 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.933752 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.933909 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.934061 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.934217 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.934362 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.934513 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.934657 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.934809 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.934963 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.935114 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.935269 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.935421 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.935578 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.935754 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.935979 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.936129 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.936272 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.936417 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.936614 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.936772 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.936917 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.937088 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.937244 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.937397 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.937625 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.937884 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.938047 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.938193 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.938345 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.938531 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.938891 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.939051 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.939203 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.939356 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.939512 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.939656 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.939809 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.939953 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.940096 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.940246 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.940554 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.940714 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.940867 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.941011 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.941237 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.941394 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.941583 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.941742 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.941897 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.942051 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.942195 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.942338 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.942481 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.942640 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.942795 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.943125 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.943276 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.943429 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.943574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.944328 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.944484 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.944628 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.944780 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.944959 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.945116 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.945262 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.945406 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.945566 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.945715 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.945860 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.946103 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.946254 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.946410 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.946555 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.946739 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.946895 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.947049 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.947210 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.947355 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.947506 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.947658 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.947817 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.947971 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.948269 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.948431 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.948586 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.948929 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.949095 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.949242 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.949387 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.949549 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.949710 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.949863 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.950019 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.950172 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.950322 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.950322 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.950782 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.950782 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.951077 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.951317 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.951469 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.951469 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.951741 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.951892 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.952053 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.952204 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.952348 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.952498 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.952657 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.952825 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.952976 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.953338 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.953491 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.953709 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.953854 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.954007 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.954152 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.954295 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.954445 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.954596 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.954747 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.954901 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.955063 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.955219 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.955365 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.955516 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.955668 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.955821 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.955967 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.956205 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.956356 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.956508 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.956660 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.956855 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.957012 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.957184 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.957340 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.957484 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.957667 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.957813 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.957956 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.958110 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.958261 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.958413 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.958572 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.958723 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.959615 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.959789 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.959937 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.960080 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.960234 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.960379 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.960531 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.960840 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.960992 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.961152 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.961297 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.961615 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.961791 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.961947 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.962111 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.962265 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.962416 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.962561 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.962711 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.962990 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.963139 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.963536 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.963692 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.963837 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.963988 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.964132 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.964275 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.964444 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.964600 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.964753 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.964906 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.965051 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.965201 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.965359 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.965545 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.965709 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.965854 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.966004 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.966249 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.966414 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.966575 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.967370 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.967523 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.967669 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.967821 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.967964 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.968108 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.968260 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.968412 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.968804 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.969223 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.969443 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.969651 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.969883 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.970043 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.970188 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.970331 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.970730 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.971784 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.971939 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.972097 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.972249 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.972394 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.972538 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.972712 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.972867 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.973032 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.973257 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.973433 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.973819 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.973978 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.974124 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.974278 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.974423 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.974568 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.974726 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.974893 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.975044 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.975191 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.975335 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.975487 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.975646 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.975791 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.975943 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.976087 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.976239 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.976486 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.976648 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.976801 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.977013 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.977171 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.977324 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.977476 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.977662 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.977816 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.977968 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.978113 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.978264 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.978417 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.978569 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.978713 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.978863 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.979019 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.979334 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.979505 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.979651 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.980030 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.980189 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.980333 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.980479 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.980637 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.980788 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.980933 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.981074 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.981403 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.981816 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.981999 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.982276 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.982409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.982555 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.982645 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.982736 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.982829 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.982914 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.982998 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.983086 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.983185 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.983496 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.983598 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.983771 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.983860 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.983952 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.984044 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.984137 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.984222 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.984305 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.984395 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.984486 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.984570 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.984665 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.984749 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.984830 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.984912 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.984994 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.985085 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.985177 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.985268 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.985351 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.985440 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.985552 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.985654 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.985739 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.985829 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.985912 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.985912 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.986101 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.986198 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.986290 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.986380 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.986694 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.986792 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.986884 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.986978 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.987137 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.987137 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.987304 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.987396 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.987488 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.987488 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.987650 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.987733 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.987822 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.987913 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.988051 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.988146 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.988238 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.988238 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.988399 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.988482 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.988578 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.988670 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.988762 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.988762 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.988922 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.988922 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.989087 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.989172 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.989264 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.989264 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.989554 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.989644 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.989742 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.989841 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.989926 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.989926 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.990088 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.990173 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.990264 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.990357 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.990447 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.991032 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.991117 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.991214 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.991377 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.991465 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.991547 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.991629 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.991884 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.991986 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.992081 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.992166 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.992258 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.992350 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.992434 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.992517 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.992608 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.992699 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.992783 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.992866 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.992948 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.993045 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.993130 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.993221 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.993312 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.993397 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.993548 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.993654 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.993748 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.993840 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.993982 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.994079 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.994163 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.994255 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.994339 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.994429 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.994513 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.994602 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.994692 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.994785 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.994869 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.994951 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.995034 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.995116 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.995212 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.995304 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.995388 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.995478 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.995568 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.995666 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.995824 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.995912 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.996002 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.996087 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.996169 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.996251 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.996341 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.996432 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.996515 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.996620 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.996868 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.996981 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.997071 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.997216 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.997312 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.997397 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.997469 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.997617 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.997693 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.997778 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.997863 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.997942 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.998023 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.998117 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.998208 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.998292 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.998383 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.998474 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.998557 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.998653 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.998744 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.998827 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.998904 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.998993 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.999083 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.999175 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.999268 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.999362 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.999453 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.999532 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.999615 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.999694 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.999769 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.999860 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:09.999943 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.000014 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.000105 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.000105 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.000267 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.000345 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.000426 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.000509 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.000607 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.000698 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.000788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.000871 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.000953 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.001029 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.001125 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.001216 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.001307 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.001397 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.001488 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.001659 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.001820 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.002029 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.002128 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.002221 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.002312 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.002413 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.002516 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.002602 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.002691 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.002775 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.002857 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.002952 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.003044 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.003129 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.003211 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.003292 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.003382 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.003476 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.003568 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.003640 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.003710 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.003787 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.003871 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.003942 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.004059 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.004194 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.004291 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.004376 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.004468 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.004560 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.004644 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.004727 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.004833 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.004927 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.005021 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.005106 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.005195 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.005313 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.005406 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.005491 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.005610 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.005691 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.005782 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.005872 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.005963 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.006098 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.006838 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.007122 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.007258 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.007372 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.007491 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.007620 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.007733 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.007842 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.007958 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.008077 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.008189 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.008308 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.008424 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.008535 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.008644 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.008753 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.008869 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.009028 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.009145 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.009254 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.009364 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.009480 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.009677 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.009791 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.009908 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.010019 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.010128 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.010245 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.010366 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.010485 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.010603 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.010714 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.010824 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.010940 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.011089 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.011187 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.011273 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.011273 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.011424 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.011507 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.011599 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.011691 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.011776 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.011854 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.011931 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.012032 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.012110 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.012181 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.012249 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.012318 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.012387 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.012466 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.012543 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.012620 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.012701 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.012773 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.012841 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.012923 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.012995 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.013063 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.013146 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.013217 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.013285 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.013364 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.013364 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.013364 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.013364 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.013788 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.013908 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.013908 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.014137 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.014255 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.014367 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.014476 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.014664 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.014664 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.014891 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.015004 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.015121 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.015221 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.015317 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.015410 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.015558 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.015653 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.015752 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.015837 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.015928 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.016022 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.016115 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.016199 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.016289 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.016382 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.016473 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.016557 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.016646 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.016839 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.016935 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.017145 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.017303 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.017441 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.017607 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.017790 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.017884 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.018111 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.018213 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.018431 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.018530 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.018747 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.018838 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.019066 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.019180 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.019379 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.019498 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.019808 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.019914 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.020124 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.020221 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.020437 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.020529 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.020752 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.020891 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.021065 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.021161 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.021375 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.021474 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.021742 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.021851 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.022065 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.022157 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.022380 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.022508 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.022693 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.022809 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.023003 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.023112 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.023330 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.023429 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.023636 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.023744 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.023967 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.024068 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.024360 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.024467 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.024695 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.024794 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.025011 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.025128 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.025398 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.025533 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.025769 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.025879 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.026082 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.026173 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.026414 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.026507 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.026723 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.026812 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.027045 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.027136 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.027358 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.027460 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.027677 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.027770 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.027994 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.028094 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.028309 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.028407 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.028632 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.028720 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.028946 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.029045 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.029265 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.029359 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.029619 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.029716 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.029944 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.030046 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.030276 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.030374 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.030600 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.030701 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.030930 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.031052 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.031333 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.031441 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.031660 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.031758 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.031974 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.032078 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.032292 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.032397 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.032608 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.032717 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.032915 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.033022 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.033230 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.033319 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.033564 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.033669 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.033879 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.033968 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.034190 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.034299 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.034504 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.034601 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.034815 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.034914 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.035126 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.035216 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.035440 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.035538 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.035749 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.035843 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.036054 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.036153 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.036363 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.036461 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.036693 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.036795 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.037002 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.037101 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.037350 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.037469 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.037706 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.037837 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.038015 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.038125 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.038347 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.038459 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.038653 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.038755 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.039355 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.039433 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.039519 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.039592 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.039668 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.039739 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.040167 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.040323 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.040493 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.040652 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.040652 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.040988 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.040988 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.041307 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.041569 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.041731 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.042061 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.042227 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.042552 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.042934 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.043073 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.043224 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.043366 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.043507 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.043646 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.043794 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.043933 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.044088 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.044246 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.044389 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.044542 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.044681 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.044828 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.044973 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.045069 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.045155 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.045237 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.045328 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.045416 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.045644 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.045736 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.045819 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.045909 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.045993 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.046090 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.046176 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.046258 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.046340 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.046423 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.046505 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.046622 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.046716 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.046929 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.047020 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.047260 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.047359 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.047571 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.047663 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.047903 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.047998 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.048220 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.048317 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.048529 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.048623 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.048838 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.048938 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.049146 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.049250 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.049543 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.049664 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.049828 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.049926 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.050161 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.050261 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.050481 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.050577 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.050809 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.050907 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.051128 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.051233 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.051445 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.051547 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.051766 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.051865 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.052085 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.052195 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.052404 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.052502 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.052719 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.052830 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.053572 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.053774 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.053977 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.054072 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.054306 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.054406 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.054669 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.054880 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.055030 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.055216 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.055538 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.055673 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.055859 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.055959 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.056179 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.056278 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.056493 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.056583 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.056810 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.056905 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.057125 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.057215 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.057438 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.057555 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.057784 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.057880 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.058100 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.058193 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.058417 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.058522 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.058733 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.058826 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.059064 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.059161 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.059387 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.059490 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.059716 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.059812 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.060036 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.060135 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.060356 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.060455 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.060670 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.060760 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.060993 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.061104 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.061309 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.061419 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.061815 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.061935 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.062024 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.062116 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.062290 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.062382 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.062601 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.062692 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.062916 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.063018 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.063232 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.063331 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.063553 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.063691 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.063868 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.063984 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.064182 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.064316 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.064494 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.064594 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.064807 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.064896 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.065099 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.065212 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.065415 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.065546 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.065765 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.065875 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.066093 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.066194 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.066407 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.066505 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.066726 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.066829 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.067043 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.067134 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.067360 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.067568 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.067724 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.067888 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.068189 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.068280 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.068506 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.068653 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.069393 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.069544 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.069750 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.069843 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.070082 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.070189 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.070405 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.070504 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.070728 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.070826 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.071044 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.071136 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.071361 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.071496 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.071671 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.071771 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.071985 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.072094 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.072294 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.072388 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.072604 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.072704 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.072913 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.073048 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.073231 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.073336 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.073559 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.073681 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.073885 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.074103 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.074204 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.074469 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.074721 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.074841 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.075077 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.075191 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.075401 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.075512 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.075737 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.075869 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.076058 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.076158 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.076379 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.076494 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.076692 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.076801 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.077008 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.077110 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.077317 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.077417 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.077655 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.077770 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.077966 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.078074 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.078278 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.078369 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.078587 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.078687 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.078898 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.078990 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.079213 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.079311 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.079526 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.079618 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.079832 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.079930 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.080146 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.080245 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.080452 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.080544 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.080769 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.080866 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.081081 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.081172 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.081386 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.081477 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.081721 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.081822 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.082034 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.082154 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.082339 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.082441 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.082647 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.082749 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.082956 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.083087 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.083263 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.083371 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.083584 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.083695 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.083894 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.084006 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.084303 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.084406 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.084622 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.084714 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.084937 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.085049 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.085277 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.085378 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.085634 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.085747 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.085945 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.086036 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.086262 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.086363 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.086566 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.086657 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.086877 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.086970 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.087198 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.087297 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.087516 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.087644 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.087834 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.088008 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.088161 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.088308 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.088441 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.088530 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.088780 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.089026 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.089126 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.089369 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.089641 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.089757 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.089982 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.090081 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.090304 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.090403 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.090641 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.090747 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.090966 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.091056 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.091280 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.091370 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.091589 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.091734 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.091897 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.091997 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.092215 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.092313 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.092526 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.092631 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.092840 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.092931 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.093150 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.093248 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.093464 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.093645 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.093805 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.093907 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.094117 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.094232 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.094426 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.094532 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.094737 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.094828 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.095050 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.095150 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.095367 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.095744 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.095943 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.096055 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.096254 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.096363 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.096566 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.096660 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.096877 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.096969 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.097195 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.097302 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.097553 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.097656 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.097880 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.097994 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.098196 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.098305 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.098511 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.098619 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.098827 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.098935 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.099142 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.099256 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.099452 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.099559 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.099766 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.099891 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.100108 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.100211 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.100428 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.100538 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.100739 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.100838 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.101072 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.101179 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.101381 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.101569 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.101824 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.101940 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.102140 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.102238 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.102454 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.102553 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.102775 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.102878 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.103088 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.103181 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.103420 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.103570 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.103733 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.103835 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.104048 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.104139 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.104367 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.104469 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.104682 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.104835 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.105018 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.105111 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.105358 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.105450 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.105703 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.105805 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.106018 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.106110 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.106327 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.106462 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.106636 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.106729 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.106944 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.107035 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.107256 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.107354 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.107569 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.107662 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.107877 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.107974 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.108185 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.108286 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.108492 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.108629 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.108798 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.108925 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.109104 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.109205 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.109410 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.109530 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.109749 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.109840 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.110052 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.110194 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.110359 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.110458 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.110704 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.110803 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.110967 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.111066 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.111268 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.111359 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.111572 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.111663 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.111881 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.112003 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.112186 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.112299 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.112492 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.112592 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.112795 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.112948 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.113092 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.113230 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.113389 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.113611 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.113764 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.113869 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.114009 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.114110 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.114345 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.114456 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.114683 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.114783 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.115003 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.115106 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.115327 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.115429 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.116165 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.116310 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.116496 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.116651 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.116796 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.116947 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.117117 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.117267 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.117434 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.117598 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.117777 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.117890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.118091 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.118183 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.118409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.118508 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.118724 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.118830 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.119035 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.119135 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.119349 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.119447 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.119660 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.119752 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.119972 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.120072 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.120283 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.120384 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.120608 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.120699 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.120934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.121026 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.121247 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.121347 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.121596 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.121692 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.121931 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.122093 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.122231 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.122331 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.122546 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.122637 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.122860 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.122954 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.123172 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.123276 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.123489 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.123582 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.123800 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.123903 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.124108 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.124214 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.124421 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.124513 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.124731 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.124832 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.125044 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.125137 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.125351 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.125451 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.125690 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.125787 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.126010 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.126215 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.126330 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.126432 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.126643 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.126732 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.126975 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.127074 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.127287 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.127427 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.127616 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.127718 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.127944 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.128038 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.128292 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.128383 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.128603 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.128709 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.128937 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.129038 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.129258 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.129367 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.129592 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.129702 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.129841 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 03 14:51:10.129934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.130199 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:51:10.130443 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 03 14:51:10.192120 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO dbcounter [None req-b76456f6-f634-494e-8d83-e18eaf66972c None None] Registered counter for database nova_api Oct 03 14:51:10.192275 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO dbcounter [None req-89e9cd59-f1ce-403b-b002-35345d59bb4b None None] Registered counter for database nova_api Oct 03 14:51:10.212772 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_db.sqlalchemy.engines [None req-b76456f6-f634-494e-8d83-e18eaf66972c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126851) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 14:51:10.214809 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_db.sqlalchemy.engines [None req-89e9cd59-f1ce-403b-b002-35345d59bb4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126852) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 14:51:10.219853 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writer thread running {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 14:51:10.221851 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writer thread running {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 14:51:10.276272 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.context [None req-b76456f6-f634-494e-8d83-e18eaf66972c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),be5c6f43-0ff9-4454-a14a-9cca214f362b(cell1) {{(pid=126851) load_cells /opt/stack/nova/nova/context.py:464}} Oct 03 14:51:10.277459 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.context [None req-89e9cd59-f1ce-403b-b002-35345d59bb4b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),be5c6f43-0ff9-4454-a14a-9cca214f362b(cell1) {{(pid=126852) load_cells /opt/stack/nova/nova/context.py:464}} Oct 03 14:51:10.280354 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b76456f6-f634-494e-8d83-e18eaf66972c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:10.280853 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b76456f6-f634-494e-8d83-e18eaf66972c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:10.281518 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-89e9cd59-f1ce-403b-b002-35345d59bb4b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:10.282002 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-89e9cd59-f1ce-403b-b002-35345d59bb4b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:10.282452 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b76456f6-f634-494e-8d83-e18eaf66972c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:10.283219 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b76456f6-f634-494e-8d83-e18eaf66972c None None] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:10.283669 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b76456f6-f634-494e-8d83-e18eaf66972c None None] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:10.283791 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-89e9cd59-f1ce-403b-b002-35345d59bb4b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:10.284426 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-89e9cd59-f1ce-403b-b002-35345d59bb4b None None] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:10.284859 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-89e9cd59-f1ce-403b-b002-35345d59bb4b None None] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:10.285757 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b76456f6-f634-494e-8d83-e18eaf66972c None None] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:10.286910 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-89e9cd59-f1ce-403b-b002-35345d59bb4b None None] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:10.288273 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO dbcounter [None req-b76456f6-f634-494e-8d83-e18eaf66972c None None] Registered counter for database nova_cell0 Oct 03 14:51:10.289490 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO dbcounter [None req-89e9cd59-f1ce-403b-b002-35345d59bb4b None None] Registered counter for database nova_cell0 Oct 03 14:51:10.292789 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO dbcounter [None req-b76456f6-f634-494e-8d83-e18eaf66972c None None] Registered counter for database nova_cell1 Oct 03 14:51:10.293573 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO dbcounter [None req-89e9cd59-f1ce-403b-b002-35345d59bb4b None None] Registered counter for database nova_cell1 Oct 03 14:51:10.300757 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_db.sqlalchemy.engines [None req-b76456f6-f634-494e-8d83-e18eaf66972c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126851) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 14:51:10.302885 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_db.sqlalchemy.engines [None req-89e9cd59-f1ce-403b-b002-35345d59bb4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126852) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 14:51:10.304683 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_db.sqlalchemy.engines [None req-89e9cd59-f1ce-403b-b002-35345d59bb4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126852) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 14:51:10.305961 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_db.sqlalchemy.engines [None req-b76456f6-f634-494e-8d83-e18eaf66972c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126851) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 14:51:10.308018 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writer thread running {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 14:51:10.311590 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writer thread running {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 14:51:10.313714 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writer thread running {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 14:51:10.451588 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writer thread running {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 14:51:10.461478 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO dbcounter [None req-b76456f6-f634-494e-8d83-e18eaf66972c None None] Registered counter for database nova_cell0 Oct 03 14:51:10.463480 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO dbcounter [None req-89e9cd59-f1ce-403b-b002-35345d59bb4b None None] Registered counter for database nova_cell0 Oct 03 14:51:10.468524 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_db.sqlalchemy.engines [None req-b76456f6-f634-494e-8d83-e18eaf66972c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126851) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 14:51:10.470272 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_db.sqlalchemy.engines [None req-89e9cd59-f1ce-403b-b002-35345d59bb4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126852) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 14:51:10.473773 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writer thread running {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 14:51:10.475486 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writer thread running {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 14:51:10.796665 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: WARNING keystonemiddleware.auth_token [None req-89e9cd59-f1ce-403b-b002-35345d59bb4b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 14:51:10.797738 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: WARNING keystonemiddleware.auth_token [None req-b76456f6-f634-494e-8d83-e18eaf66972c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 14:51:10.804097 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: WARNING keystonemiddleware.auth_token [None req-89e9cd59-f1ce-403b-b002-35345d59bb4b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 14:51:10.805052 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: WARNING keystonemiddleware.auth_token [None req-b76456f6-f634-494e-8d83-e18eaf66972c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 14:51:11.152077 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: WARNING keystonemiddleware.auth_token [None req-b76456f6-f634-494e-8d83-e18eaf66972c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 14:51:11.152880 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: WARNING keystonemiddleware.auth_token [None req-89e9cd59-f1ce-403b-b002-35345d59bb4b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 14:51:11.158123 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: WARNING keystonemiddleware.auth_token [None req-b76456f6-f634-494e-8d83-e18eaf66972c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 14:51:11.158935 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: WARNING keystonemiddleware.auth_token [None req-89e9cd59-f1ce-403b-b002-35345d59bb4b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 14:51:11.163883 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558f0b5f69c0 pid: 126851 (default app) Oct 03 14:51:11.164761 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558f0b5f69c0 pid: 126852 (default app) Oct 03 14:51:47.077926 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_api:SELECT=3 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:51:47.080157 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=3 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:51:47.081870 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell0:SELECT=3 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:51:47.083571 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell0:SELECT=3 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:51:48.406037 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-7e5a1b35-117c-48df-a71c-a24a0cc999c0 tempest-VolumesNegativeTest-693501523 tempest-VolumesNegativeTest-693501523-project] Action: 'create', calling method: .version_select at 0x7fe0d4449550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1655599979", "metadata": {"Type": "work"}}} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:51:48.416574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-7e5a1b35-117c-48df-a71c-a24a0cc999c0 tempest-VolumesNegativeTest-693501523 tempest-VolumesNegativeTest-693501523-project] Request method failure captured: Oct 03 14:51:48.416574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 03 14:51:48.416574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept: application/json Oct 03 14:51:48.416574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept-Encoding: identity Oct 03 14:51:48.416574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Connection: close Oct 03 14:51:48.416574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Length: 122 Oct 03 14:51:48.416574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Type: application/json Oct 03 14:51:48.416574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Host: 10.222.0.46 Oct 03 14:51:48.416574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Openstack-System-Scope: None Oct 03 14:51:48.416574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: User-Agent: python-urllib3/1.26.12 Oct 03 14:51:48.416574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Auth-Token: gAAAAABjOvcC74pDVTfeMLOwcFPj2YqiCwQMlYsu1MqbQjajUF96TWcYvjCJxxWCac3U59bxEHDKYV6_XW0yHxgLXhEsVvZDVQOP3JYA8eU6XhQTTvjla8S80oSFaA2BCNepKF-hqsHtYlwkk36dBUySBeaOoxmsruY3J3PotroegOUr_FUKzzU Oct 03 14:51:48.416574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Id: None Oct 03 14:51:48.416574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Name: None Oct 03 14:51:48.416574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Identity-Status: Confirmed Oct 03 14:51:48.416574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Is-Admin-Project: True Oct 03 14:51:48.416574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Id: default Oct 03 14:51:48.416574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Name: Default Oct 03 14:51:48.416574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Id: 85e2a5410c7f43b88a9b4c643b80ae85 Oct 03 14:51:48.416574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Name: tempest-VolumesNegativeTest-693501523 Oct 03 14:51:48.416574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Role: member,reader Oct 03 14:51:48.416574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Roles: member,reader Oct 03 14:51:48.418101 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/85e2a5410c7f43b88a9b4c643b80ae85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_85e2a5410c7f43b88a9b4c643b80ae85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/85e2a5410c7f43b88a9b4c643b80ae85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/85e2a5410c7f43b88a9b4c643b80ae85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 14:51:48.418101 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant: tempest-VolumesNegativeTest-693501523 Oct 03 14:51:48.418101 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Id: 85e2a5410c7f43b88a9b4c643b80ae85 Oct 03 14:51:48.418101 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Name: tempest-VolumesNegativeTest-693501523 Oct 03 14:51:48.418101 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User: tempest-VolumesNegativeTest-693501523-project Oct 03 14:51:48.418101 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Id: default Oct 03 14:51:48.418101 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Name: Default Oct 03 14:51:48.418101 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Id: 187717bf784d4526a949a13d0e437237 Oct 03 14:51:48.418101 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Name: tempest-VolumesNegativeTest-693501523-project Oct 03 14:51:48.418101 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Oct 03 14:51:48.418101 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1655599979", "metadata": {"Type": "work"}}} Oct 03 14:51:48.418101 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: method: Oct 03 14:51:48.418101 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 03 14:51:48.418949 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1655599979', 'metadata': {'Type': 'work'}}}} Oct 03 14:51:48.418949 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:51:48.418949 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:51:48.418949 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:51:48.418949 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:51:48.418949 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:51:48.418949 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:51:48.418949 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 03 14:51:48.418949 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:51:48.418949 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 03 14:51:48.418949 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 03 14:51:48.418949 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:51:48.418949 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 03 14:51:48.418949 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi '#$%' Oct 03 14:51:48.418949 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:51:48.418949 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:51:48.418949 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:51:48.418949 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:51:48.418949 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:51:48.418949 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:51:48.418949 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:51:48.418949 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:51:48.420244 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:51:48.420244 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:51:48.420244 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:51:48.420244 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:51:48.420244 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:51:48.420244 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:51:48.420244 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:51:48.420244 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:51:48.420244 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:51:48.420244 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:51:48.420244 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 03 14:51:48.420244 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:51:48.420244 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:51:48.420244 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:51:48.420244 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:51:48.420244 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:51:48.420244 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:51:48.420244 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:51:48.420244 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:51:48.421408 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 03 14:51:48.421408 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:51:48.426322 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-7e5a1b35-117c-48df-a71c-a24a0cc999c0 tempest-VolumesNegativeTest-693501523 tempest-VolumesNegativeTest-693501523-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=126851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:51:48.429560 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-7e5a1b35-117c-48df-a71c-a24a0cc999c0 tempest-VolumesNegativeTest-693501523 tempest-VolumesNegativeTest-693501523-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.373734 Oct 03 14:51:48.430628 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 1/1] 10.222.0.46 () {60 vars in 1156 bytes} [Mon Oct 3 14:51:47 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1378 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:51:48.862857 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-aa8fef77-14e0-4a39-b8cc-ead08aefb174 tempest-VolumesNegativeTest-693501523 tempest-VolumesNegativeTest-693501523-project] Action: 'create', calling method: .version_select at 0x7fe0d44f8f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-851440500", "metadata": {"Type": "work"}}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:51:48.870331 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-aa8fef77-14e0-4a39-b8cc-ead08aefb174 tempest-VolumesNegativeTest-693501523 tempest-VolumesNegativeTest-693501523-project] Request method failure captured: Oct 03 14:51:48.870331 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 03 14:51:48.870331 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept: application/json Oct 03 14:51:48.870331 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept-Encoding: identity Oct 03 14:51:48.870331 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Connection: close Oct 03 14:51:48.870331 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Length: 119 Oct 03 14:51:48.870331 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Type: application/json Oct 03 14:51:48.870331 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Host: 10.222.0.46 Oct 03 14:51:48.870331 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Openstack-System-Scope: None Oct 03 14:51:48.870331 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: User-Agent: python-urllib3/1.26.12 Oct 03 14:51:48.870331 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Auth-Token: gAAAAABjOvcC74pDVTfeMLOwcFPj2YqiCwQMlYsu1MqbQjajUF96TWcYvjCJxxWCac3U59bxEHDKYV6_XW0yHxgLXhEsVvZDVQOP3JYA8eU6XhQTTvjla8S80oSFaA2BCNepKF-hqsHtYlwkk36dBUySBeaOoxmsruY3J3PotroegOUr_FUKzzU Oct 03 14:51:48.870331 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Id: None Oct 03 14:51:48.870331 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Name: None Oct 03 14:51:48.870331 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Identity-Status: Confirmed Oct 03 14:51:48.870331 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Is-Admin-Project: True Oct 03 14:51:48.870331 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Id: default Oct 03 14:51:48.870331 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Name: Default Oct 03 14:51:48.870331 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Id: 85e2a5410c7f43b88a9b4c643b80ae85 Oct 03 14:51:48.870331 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Name: tempest-VolumesNegativeTest-693501523 Oct 03 14:51:48.870331 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Role: member,reader Oct 03 14:51:48.870331 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Roles: member,reader Oct 03 14:51:48.871934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/85e2a5410c7f43b88a9b4c643b80ae85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_85e2a5410c7f43b88a9b4c643b80ae85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/85e2a5410c7f43b88a9b4c643b80ae85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/85e2a5410c7f43b88a9b4c643b80ae85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 14:51:48.871934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant: tempest-VolumesNegativeTest-693501523 Oct 03 14:51:48.871934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Id: 85e2a5410c7f43b88a9b4c643b80ae85 Oct 03 14:51:48.871934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Name: tempest-VolumesNegativeTest-693501523 Oct 03 14:51:48.871934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User: tempest-VolumesNegativeTest-693501523-project Oct 03 14:51:48.871934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Id: default Oct 03 14:51:48.871934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Name: Default Oct 03 14:51:48.871934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Id: 187717bf784d4526a949a13d0e437237 Oct 03 14:51:48.871934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Name: tempest-VolumesNegativeTest-693501523-project Oct 03 14:51:48.871934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Oct 03 14:51:48.871934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-851440500", "metadata": {"Type": "work"}}} Oct 03 14:51:48.871934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: method: Oct 03 14:51:48.871934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 03 14:51:48.872900 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-851440500', 'metadata': {'Type': 'work'}}}} Oct 03 14:51:48.872900 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:51:48.872900 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:51:48.872900 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:51:48.872900 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:51:48.872900 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:51:48.872900 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:51:48.872900 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 03 14:51:48.872900 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:51:48.872900 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 03 14:51:48.872900 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 03 14:51:48.872900 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:51:48.872900 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 03 14:51:48.872900 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi '0' Oct 03 14:51:48.872900 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:51:48.872900 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:51:48.872900 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:51:48.872900 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:51:48.872900 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:51:48.872900 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:51:48.872900 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:51:48.872900 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:51:48.875557 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:51:48.875557 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:51:48.875557 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:51:48.875557 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:51:48.875557 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:51:48.875557 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:51:48.875557 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:51:48.875557 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:51:48.875557 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:51:48.875557 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:51:48.875557 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 03 14:51:48.875557 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:51:48.875557 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:51:48.875557 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:51:48.875557 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:51:48.875557 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:51:48.875557 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:51:48.875557 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:51:48.875557 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:51:48.877177 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 03 14:51:48.877177 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:51:48.880319 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-aa8fef77-14e0-4a39-b8cc-ead08aefb174 tempest-VolumesNegativeTest-693501523 tempest-VolumesNegativeTest-693501523-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=126852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:51:48.880319 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-aa8fef77-14e0-4a39-b8cc-ead08aefb174 tempest-VolumesNegativeTest-693501523 tempest-VolumesNegativeTest-693501523-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.442594 Oct 03 14:51:48.880825 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 1/2] 10.222.0.46 () {60 vars in 1156 bytes} [Mon Oct 3 14:51:48 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 445 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:51:48.889792 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-7b57d655-8dd5-4624-a8c9-a65ccd8909bd tempest-VolumesNegativeTest-693501523 tempest-VolumesNegativeTest-693501523-project] Action: 'create', calling method: .version_select at 0x7fe0d4449e50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-986911396", "metadata": {"Type": "work"}}} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:51:48.894716 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-7b57d655-8dd5-4624-a8c9-a65ccd8909bd tempest-VolumesNegativeTest-693501523 tempest-VolumesNegativeTest-693501523-project] Request method failure captured: Oct 03 14:51:48.894716 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 03 14:51:48.894716 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept: application/json Oct 03 14:51:48.894716 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept-Encoding: identity Oct 03 14:51:48.894716 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Connection: close Oct 03 14:51:48.894716 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Length: 118 Oct 03 14:51:48.894716 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Type: application/json Oct 03 14:51:48.894716 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Host: 10.222.0.46 Oct 03 14:51:48.894716 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Openstack-System-Scope: None Oct 03 14:51:48.894716 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: User-Agent: python-urllib3/1.26.12 Oct 03 14:51:48.894716 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Auth-Token: gAAAAABjOvcC74pDVTfeMLOwcFPj2YqiCwQMlYsu1MqbQjajUF96TWcYvjCJxxWCac3U59bxEHDKYV6_XW0yHxgLXhEsVvZDVQOP3JYA8eU6XhQTTvjla8S80oSFaA2BCNepKF-hqsHtYlwkk36dBUySBeaOoxmsruY3J3PotroegOUr_FUKzzU Oct 03 14:51:48.894716 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Id: None Oct 03 14:51:48.894716 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Name: None Oct 03 14:51:48.894716 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Identity-Status: Confirmed Oct 03 14:51:48.894716 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Is-Admin-Project: True Oct 03 14:51:48.894716 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Id: default Oct 03 14:51:48.894716 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Name: Default Oct 03 14:51:48.894716 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Id: 85e2a5410c7f43b88a9b4c643b80ae85 Oct 03 14:51:48.894716 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Name: tempest-VolumesNegativeTest-693501523 Oct 03 14:51:48.894716 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Role: member,reader Oct 03 14:51:48.894716 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Roles: member,reader Oct 03 14:51:48.896668 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/85e2a5410c7f43b88a9b4c643b80ae85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_85e2a5410c7f43b88a9b4c643b80ae85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/85e2a5410c7f43b88a9b4c643b80ae85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/85e2a5410c7f43b88a9b4c643b80ae85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 14:51:48.896668 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant: tempest-VolumesNegativeTest-693501523 Oct 03 14:51:48.896668 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Id: 85e2a5410c7f43b88a9b4c643b80ae85 Oct 03 14:51:48.896668 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Name: tempest-VolumesNegativeTest-693501523 Oct 03 14:51:48.896668 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User: tempest-VolumesNegativeTest-693501523-project Oct 03 14:51:48.896668 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Id: default Oct 03 14:51:48.896668 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Name: Default Oct 03 14:51:48.896668 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Id: 187717bf784d4526a949a13d0e437237 Oct 03 14:51:48.896668 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Name: tempest-VolumesNegativeTest-693501523-project Oct 03 14:51:48.896668 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Oct 03 14:51:48.896668 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-986911396", "metadata": {"Type": "work"}}} Oct 03 14:51:48.896668 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: method: Oct 03 14:51:48.896668 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 03 14:51:48.897489 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-986911396', 'metadata': {'Type': 'work'}}}} Oct 03 14:51:48.897489 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:51:48.897489 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:51:48.897489 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:51:48.897489 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:51:48.897489 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:51:48.897489 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:51:48.897489 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 03 14:51:48.897489 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:51:48.897489 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 03 14:51:48.897489 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 03 14:51:48.897489 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:51:48.897489 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 03 14:51:48.897489 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi '' Oct 03 14:51:48.897489 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:51:48.897489 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:51:48.897489 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:51:48.897489 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:51:48.897489 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:51:48.897489 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:51:48.897489 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:51:48.897489 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:51:48.898855 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:51:48.898855 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:51:48.898855 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:51:48.898855 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:51:48.898855 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:51:48.898855 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:51:48.898855 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:51:48.898855 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:51:48.898855 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:51:48.898855 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:51:48.898855 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 03 14:51:48.898855 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:51:48.898855 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:51:48.898855 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:51:48.898855 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:51:48.898855 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:51:48.898855 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:51:48.898855 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:51:48.898855 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:51:48.899951 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 03 14:51:48.899951 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:51:48.907036 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-7b57d655-8dd5-4624-a8c9-a65ccd8909bd tempest-VolumesNegativeTest-693501523 tempest-VolumesNegativeTest-693501523-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=126851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:51:48.908248 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-7b57d655-8dd5-4624-a8c9-a65ccd8909bd tempest-VolumesNegativeTest-693501523 tempest-VolumesNegativeTest-693501523-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.022558 Oct 03 14:51:48.913655 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 2/3] 10.222.0.46 () {60 vars in 1156 bytes} [Mon Oct 3 14:51:48 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:51:48.924842 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-0d3f8421-885d-46ad-a133-6e01bac17d86 tempest-VolumesNegativeTest-693501523 tempest-VolumesNegativeTest-693501523-project] Calling method '.version_select at 0x7fe0d4489af0>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:48.974817 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_api:SELECT=3 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:51:48.990926 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell0:SELECT=3 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:51:48.993180 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=3 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:51:48.994884 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell0:SELECT=3 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:51:49.466327 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.wsgi [None req-0d3f8421-885d-46ad-a133-6e01bac17d86 tempest-VolumesNegativeTest-693501523 tempest-VolumesNegativeTest-693501523-project] HTTP exception thrown: Volume tempest-invalid-7238337 could not be found. Oct 03 14:51:49.473633 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-0d3f8421-885d-46ad-a133-6e01bac17d86 tempest-VolumesNegativeTest-693501523 tempest-VolumesNegativeTest-693501523-project] Request method failure captured: Oct 03 14:51:49.473633 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-7238337 HTTP/1.1 Oct 03 14:51:49.473633 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept: application/json Oct 03 14:51:49.473633 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept-Encoding: identity Oct 03 14:51:49.473633 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Connection: close Oct 03 14:51:49.473633 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Length: 0 Oct 03 14:51:49.473633 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Type: application/json Oct 03 14:51:49.473633 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Host: 10.222.0.46 Oct 03 14:51:49.473633 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Openstack-System-Scope: None Oct 03 14:51:49.473633 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: User-Agent: python-urllib3/1.26.12 Oct 03 14:51:49.473633 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Auth-Token: gAAAAABjOvcC74pDVTfeMLOwcFPj2YqiCwQMlYsu1MqbQjajUF96TWcYvjCJxxWCac3U59bxEHDKYV6_XW0yHxgLXhEsVvZDVQOP3JYA8eU6XhQTTvjla8S80oSFaA2BCNepKF-hqsHtYlwkk36dBUySBeaOoxmsruY3J3PotroegOUr_FUKzzU Oct 03 14:51:49.473633 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Id: None Oct 03 14:51:49.473633 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Name: None Oct 03 14:51:49.473633 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Identity-Status: Confirmed Oct 03 14:51:49.473633 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Is-Admin-Project: True Oct 03 14:51:49.473633 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Id: default Oct 03 14:51:49.473633 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Name: Default Oct 03 14:51:49.473633 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Id: 85e2a5410c7f43b88a9b4c643b80ae85 Oct 03 14:51:49.473633 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Name: tempest-VolumesNegativeTest-693501523 Oct 03 14:51:49.473633 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Role: member,reader Oct 03 14:51:49.473633 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Roles: member,reader Oct 03 14:51:49.475168 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/85e2a5410c7f43b88a9b4c643b80ae85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_85e2a5410c7f43b88a9b4c643b80ae85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/85e2a5410c7f43b88a9b4c643b80ae85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/85e2a5410c7f43b88a9b4c643b80ae85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 14:51:49.475168 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant: tempest-VolumesNegativeTest-693501523 Oct 03 14:51:49.475168 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Id: 85e2a5410c7f43b88a9b4c643b80ae85 Oct 03 14:51:49.475168 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Name: tempest-VolumesNegativeTest-693501523 Oct 03 14:51:49.475168 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User: tempest-VolumesNegativeTest-693501523-project Oct 03 14:51:49.475168 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Id: default Oct 03 14:51:49.475168 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Name: Default Oct 03 14:51:49.475168 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Id: 187717bf784d4526a949a13d0e437237 Oct 03 14:51:49.475168 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Name: tempest-VolumesNegativeTest-693501523-project Oct 03 14:51:49.475168 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: method: Oct 03 14:51:49.475168 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: exception: Volume tempest-invalid-7238337 could not be found. Oct 03 14:51:49.475168 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: action_args: {'id': 'tempest-invalid-7238337'} Oct 03 14:51:49.475168 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:51:49.475965 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:51:49.475965 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 14:51:49.475965 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 14:51:49.475965 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 03 14:51:49.475965 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 03 14:51:49.475965 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 03 14:51:49.475965 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 03 14:51:49.475965 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 03 14:51:49.475965 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 03 14:51:49.475965 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 03 14:51:49.475965 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 03 14:51:49.475965 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 14:51:49.475965 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 14:51:49.475965 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 14:51:49.475965 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 14:51:49.475965 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-7238337 could not be found. (HTTP 404) (Request-ID: req-cba60aeb-0be9-4f88-8724-06c3411eb65e) Oct 03 14:51:49.475965 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:51:49.475965 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:51:49.475965 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:51:49.477144 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:51:49.477144 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 03 14:51:49.477144 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 03 14:51:49.477144 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 14:51:49.477144 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 14:51:49.477144 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 14:51:49.477144 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 14:51:49.477144 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 14:51:49.477144 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 14:51:49.477144 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 14:51:49.477144 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 14:51:49.477144 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 03 14:51:49.477144 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 03 14:51:49.477144 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 03 14:51:49.477144 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 03 14:51:49.477144 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 03 14:51:49.477144 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 03 14:51:49.477144 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 03 14:51:49.477144 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 03 14:51:49.479342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 14:51:49.479342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 14:51:49.479342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 14:51:49.479342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 14:51:49.479342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-7238337 could not be found. Oct 03 14:51:49.479342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:51:49.479342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:51:49.479342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:51:49.479342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:51:49.479342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:51:49.479342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:51:49.479342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:51:49.479342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:51:49.479342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:51:49.479342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:51:49.479342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:51:49.479342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:51:49.479342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 03 14:51:49.479342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:51:49.479342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-7238337 could not be found. Oct 03 14:51:49.480481 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:51:49.480481 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:51:49.480481 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:51:49.480481 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:51:49.480481 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:51:49.480481 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:51:49.480481 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:51:49.480481 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:51:49.480481 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-7238337 could not be found. Oct 03 14:51:49.480481 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:51:49.486281 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-0d3f8421-885d-46ad-a133-6e01bac17d86 tempest-VolumesNegativeTest-693501523 tempest-VolumesNegativeTest-693501523-project] Returning 404 to user: Volume tempest-invalid-7238337 could not be found. {{(pid=126852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:51:49.487670 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-0d3f8421-885d-46ad-a133-6e01bac17d86 tempest-VolumesNegativeTest-693501523 tempest-VolumesNegativeTest-693501523-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/tempest-invalid-7238337" status: 404 len: 96 microversion: 2.1 time: 0.568248 Oct 03 14:51:49.489636 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 2/4] 10.222.0.46 () {58 vars in 1209 bytes} [Mon Oct 3 14:51:48 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-7238337 => generated 96 bytes in 572 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:51:49.503008 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-dee0ae4a-85b2-4cd0-91a1-37b26d96b69c tempest-VolumesNegativeTest-693501523 tempest-VolumesNegativeTest-693501523-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006792 Oct 03 14:51:49.503847 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 3/5] 10.222.0.46 () {58 vars in 1140 bytes} [Mon Oct 3 14:51:49 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 03 14:51:49.518215 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-a56321da-5c22-4def-bcef-f9537e515d9d tempest-VolumesNegativeTest-693501523 tempest-VolumesNegativeTest-693501523-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004026 Oct 03 14:51:49.528122 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-2f2de825-ab92-4c35-8486-ffa796945f41 tempest-VolumesNegativeTest-693501523 tempest-VolumesNegativeTest-693501523-project] Calling method '.version_select at 0x7fe0d43054c0>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:49.533363 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 3/6] 10.222.0.46 () {58 vars in 1137 bytes} [Mon Oct 3 14:51:49 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 03 14:51:50.289346 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.wsgi [None req-2f2de825-ab92-4c35-8486-ffa796945f41 tempest-VolumesNegativeTest-693501523 tempest-VolumesNegativeTest-693501523-project] HTTP exception thrown: Volume 2383a5b3-db15-4ab1-b2ac-340e17d6b957 could not be found. Oct 03 14:51:50.303551 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-2f2de825-ab92-4c35-8486-ffa796945f41 tempest-VolumesNegativeTest-693501523 tempest-VolumesNegativeTest-693501523-project] Request method failure captured: Oct 03 14:51:50.303551 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: request: DELETE /compute/v2.1/os-volumes/2383a5b3-db15-4ab1-b2ac-340e17d6b957 HTTP/1.1 Oct 03 14:51:50.303551 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept: application/json Oct 03 14:51:50.303551 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept-Encoding: identity Oct 03 14:51:50.303551 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Connection: close Oct 03 14:51:50.303551 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Length: 0 Oct 03 14:51:50.303551 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Type: application/json Oct 03 14:51:50.303551 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Host: 10.222.0.46 Oct 03 14:51:50.303551 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Openstack-System-Scope: None Oct 03 14:51:50.303551 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: User-Agent: python-urllib3/1.26.12 Oct 03 14:51:50.303551 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Auth-Token: gAAAAABjOvcC74pDVTfeMLOwcFPj2YqiCwQMlYsu1MqbQjajUF96TWcYvjCJxxWCac3U59bxEHDKYV6_XW0yHxgLXhEsVvZDVQOP3JYA8eU6XhQTTvjla8S80oSFaA2BCNepKF-hqsHtYlwkk36dBUySBeaOoxmsruY3J3PotroegOUr_FUKzzU Oct 03 14:51:50.303551 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Id: None Oct 03 14:51:50.303551 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Name: None Oct 03 14:51:50.303551 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Identity-Status: Confirmed Oct 03 14:51:50.303551 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Is-Admin-Project: True Oct 03 14:51:50.303551 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Id: default Oct 03 14:51:50.303551 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Name: Default Oct 03 14:51:50.303551 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Id: 85e2a5410c7f43b88a9b4c643b80ae85 Oct 03 14:51:50.303551 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Name: tempest-VolumesNegativeTest-693501523 Oct 03 14:51:50.303551 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Role: member,reader Oct 03 14:51:50.303551 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Roles: member,reader Oct 03 14:51:50.304815 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/85e2a5410c7f43b88a9b4c643b80ae85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_85e2a5410c7f43b88a9b4c643b80ae85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/85e2a5410c7f43b88a9b4c643b80ae85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/85e2a5410c7f43b88a9b4c643b80ae85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 14:51:50.304815 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant: tempest-VolumesNegativeTest-693501523 Oct 03 14:51:50.304815 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Id: 85e2a5410c7f43b88a9b4c643b80ae85 Oct 03 14:51:50.304815 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Name: tempest-VolumesNegativeTest-693501523 Oct 03 14:51:50.304815 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User: tempest-VolumesNegativeTest-693501523-project Oct 03 14:51:50.304815 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Id: default Oct 03 14:51:50.304815 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Name: Default Oct 03 14:51:50.304815 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Id: 187717bf784d4526a949a13d0e437237 Oct 03 14:51:50.304815 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Name: tempest-VolumesNegativeTest-693501523-project Oct 03 14:51:50.304815 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: method: Oct 03 14:51:50.304815 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: exception: Volume 2383a5b3-db15-4ab1-b2ac-340e17d6b957 could not be found. Oct 03 14:51:50.304815 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: action_args: {'id': '2383a5b3-db15-4ab1-b2ac-340e17d6b957'} Oct 03 14:51:50.304815 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:51:50.305611 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:51:50.305611 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 14:51:50.305611 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 14:51:50.305611 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 03 14:51:50.305611 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 03 14:51:50.305611 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 03 14:51:50.305611 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 03 14:51:50.305611 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 03 14:51:50.305611 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 03 14:51:50.305611 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 03 14:51:50.305611 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 03 14:51:50.305611 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 14:51:50.305611 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 14:51:50.305611 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 14:51:50.305611 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 14:51:50.305611 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2383a5b3-db15-4ab1-b2ac-340e17d6b957 could not be found. (HTTP 404) (Request-ID: req-e084090c-05dc-454e-b778-d2b5728b3308) Oct 03 14:51:50.305611 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:51:50.305611 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:51:50.305611 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:51:50.306675 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:51:50.306675 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 03 14:51:50.306675 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 03 14:51:50.306675 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 14:51:50.306675 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 14:51:50.306675 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 14:51:50.306675 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 14:51:50.306675 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 14:51:50.306675 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 14:51:50.306675 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 14:51:50.306675 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 14:51:50.306675 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 03 14:51:50.306675 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 03 14:51:50.306675 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 03 14:51:50.306675 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 03 14:51:50.306675 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 03 14:51:50.306675 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 03 14:51:50.306675 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 03 14:51:50.306675 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 03 14:51:50.307719 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 14:51:50.307719 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 14:51:50.307719 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 14:51:50.307719 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 14:51:50.307719 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2383a5b3-db15-4ab1-b2ac-340e17d6b957 could not be found. Oct 03 14:51:50.307719 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:51:50.307719 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:51:50.307719 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:51:50.307719 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:51:50.307719 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:51:50.307719 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:51:50.307719 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:51:50.307719 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:51:50.307719 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:51:50.307719 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:51:50.307719 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:51:50.307719 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:51:50.307719 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 03 14:51:50.307719 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:51:50.308783 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2383a5b3-db15-4ab1-b2ac-340e17d6b957 could not be found. Oct 03 14:51:50.308783 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:51:50.308783 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:51:50.308783 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:51:50.308783 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:51:50.308783 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:51:50.308783 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:51:50.308783 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:51:50.308783 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:51:50.308783 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2383a5b3-db15-4ab1-b2ac-340e17d6b957 could not be found. Oct 03 14:51:50.308783 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:51:50.312073 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-2f2de825-ab92-4c35-8486-ffa796945f41 tempest-VolumesNegativeTest-693501523 tempest-VolumesNegativeTest-693501523-project] Returning 404 to user: Volume 2383a5b3-db15-4ab1-b2ac-340e17d6b957 could not be found. {{(pid=126851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:51:50.313220 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-2f2de825-ab92-4c35-8486-ffa796945f41 tempest-VolumesNegativeTest-693501523 tempest-VolumesNegativeTest-693501523-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/2383a5b3-db15-4ab1-b2ac-340e17d6b957" status: 404 len: 109 microversion: 2.1 time: 0.788816 Oct 03 14:51:50.316953 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 4/7] 10.222.0.46 () {58 vars in 1248 bytes} [Mon Oct 3 14:51:49 2022] DELETE /compute/v2.1/os-volumes/2383a5b3-db15-4ab1-b2ac-340e17d6b957 => generated 109 bytes in 793 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:51:50.328791 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-bb668f3d-7793-4bab-924c-900bbcc9dbe9 tempest-VolumesNegativeTest-693501523 tempest-VolumesNegativeTest-693501523-project] Calling method '.version_select at 0x7fe0d42321f0>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:50.382490 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.wsgi [None req-bb668f3d-7793-4bab-924c-900bbcc9dbe9 tempest-VolumesNegativeTest-693501523 tempest-VolumesNegativeTest-693501523-project] HTTP exception thrown: Volume aae6beee-ac36-4441-a197-8cc20f3ca314 could not be found. Oct 03 14:51:50.385023 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-bb668f3d-7793-4bab-924c-900bbcc9dbe9 tempest-VolumesNegativeTest-693501523 tempest-VolumesNegativeTest-693501523-project] Request method failure captured: Oct 03 14:51:50.385023 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: request: GET /compute/v2.1/os-volumes/aae6beee-ac36-4441-a197-8cc20f3ca314 HTTP/1.1 Oct 03 14:51:50.385023 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept: application/json Oct 03 14:51:50.385023 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept-Encoding: identity Oct 03 14:51:50.385023 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Connection: close Oct 03 14:51:50.385023 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Length: 0 Oct 03 14:51:50.385023 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Type: application/json Oct 03 14:51:50.385023 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Host: 10.222.0.46 Oct 03 14:51:50.385023 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Openstack-System-Scope: None Oct 03 14:51:50.385023 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: User-Agent: python-urllib3/1.26.12 Oct 03 14:51:50.385023 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Auth-Token: gAAAAABjOvcC74pDVTfeMLOwcFPj2YqiCwQMlYsu1MqbQjajUF96TWcYvjCJxxWCac3U59bxEHDKYV6_XW0yHxgLXhEsVvZDVQOP3JYA8eU6XhQTTvjla8S80oSFaA2BCNepKF-hqsHtYlwkk36dBUySBeaOoxmsruY3J3PotroegOUr_FUKzzU Oct 03 14:51:50.385023 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Id: None Oct 03 14:51:50.385023 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Name: None Oct 03 14:51:50.385023 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Identity-Status: Confirmed Oct 03 14:51:50.385023 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Is-Admin-Project: True Oct 03 14:51:50.385023 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Id: default Oct 03 14:51:50.385023 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Name: Default Oct 03 14:51:50.385023 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Id: 85e2a5410c7f43b88a9b4c643b80ae85 Oct 03 14:51:50.385023 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Name: tempest-VolumesNegativeTest-693501523 Oct 03 14:51:50.385023 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Role: member,reader Oct 03 14:51:50.385023 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Roles: member,reader Oct 03 14:51:50.386698 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/85e2a5410c7f43b88a9b4c643b80ae85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_85e2a5410c7f43b88a9b4c643b80ae85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/85e2a5410c7f43b88a9b4c643b80ae85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/85e2a5410c7f43b88a9b4c643b80ae85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 14:51:50.386698 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant: tempest-VolumesNegativeTest-693501523 Oct 03 14:51:50.386698 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Id: 85e2a5410c7f43b88a9b4c643b80ae85 Oct 03 14:51:50.386698 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Name: tempest-VolumesNegativeTest-693501523 Oct 03 14:51:50.386698 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User: tempest-VolumesNegativeTest-693501523-project Oct 03 14:51:50.386698 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Id: default Oct 03 14:51:50.386698 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Name: Default Oct 03 14:51:50.386698 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Id: 187717bf784d4526a949a13d0e437237 Oct 03 14:51:50.386698 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Name: tempest-VolumesNegativeTest-693501523-project Oct 03 14:51:50.386698 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: method: Oct 03 14:51:50.386698 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: exception: Volume aae6beee-ac36-4441-a197-8cc20f3ca314 could not be found. Oct 03 14:51:50.386698 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: action_args: {'id': 'aae6beee-ac36-4441-a197-8cc20f3ca314'} Oct 03 14:51:50.386698 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:51:50.387609 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:51:50.387609 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 14:51:50.387609 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 14:51:50.387609 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 14:51:50.387609 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 14:51:50.387609 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 14:51:50.387609 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 14:51:50.387609 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 14:51:50.387609 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 14:51:50.387609 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 14:51:50.387609 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 14:51:50.387609 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 14:51:50.387609 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 14:51:50.387609 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 14:51:50.387609 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 14:51:50.387609 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume aae6beee-ac36-4441-a197-8cc20f3ca314 could not be found. (HTTP 404) (Request-ID: req-8771c2a8-d44c-4e5d-8ce1-1cc6289ff5b1) Oct 03 14:51:50.387609 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:51:50.387609 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:51:50.387609 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:51:50.389731 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:51:50.389731 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 03 14:51:50.389731 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 03 14:51:50.389731 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 14:51:50.389731 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 14:51:50.389731 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 14:51:50.389731 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 14:51:50.389731 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 14:51:50.389731 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 14:51:50.389731 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 14:51:50.389731 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 14:51:50.389731 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 14:51:50.389731 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 14:51:50.389731 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 14:51:50.389731 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 14:51:50.389731 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 14:51:50.389731 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 14:51:50.389731 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 14:51:50.389731 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 14:51:50.391874 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 14:51:50.391874 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 14:51:50.391874 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 14:51:50.391874 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 14:51:50.391874 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume aae6beee-ac36-4441-a197-8cc20f3ca314 could not be found. Oct 03 14:51:50.391874 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:51:50.391874 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:51:50.391874 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:51:50.391874 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:51:50.391874 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:51:50.391874 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:51:50.391874 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:51:50.391874 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:51:50.391874 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:51:50.391874 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:51:50.391874 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:51:50.391874 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:51:50.391874 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 03 14:51:50.391874 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:51:50.395917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume aae6beee-ac36-4441-a197-8cc20f3ca314 could not be found. Oct 03 14:51:50.395917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:51:50.395917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:51:50.395917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:51:50.395917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:51:50.395917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:51:50.395917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:51:50.395917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:51:50.395917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:51:50.395917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume aae6beee-ac36-4441-a197-8cc20f3ca314 could not be found. Oct 03 14:51:50.395917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:51:50.395917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-bb668f3d-7793-4bab-924c-900bbcc9dbe9 tempest-VolumesNegativeTest-693501523 tempest-VolumesNegativeTest-693501523-project] Returning 404 to user: Volume aae6beee-ac36-4441-a197-8cc20f3ca314 could not be found. {{(pid=126852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:51:50.395917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-bb668f3d-7793-4bab-924c-900bbcc9dbe9 tempest-VolumesNegativeTest-693501523 tempest-VolumesNegativeTest-693501523-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/aae6beee-ac36-4441-a197-8cc20f3ca314" status: 404 len: 109 microversion: 2.1 time: 0.066969 Oct 03 14:51:50.395917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 4/8] 10.222.0.46 () {58 vars in 1245 bytes} [Mon Oct 3 14:51:50 2022] GET /compute/v2.1/os-volumes/aae6beee-ac36-4441-a197-8cc20f3ca314 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:51:50.855320 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-ee2c931d-a26f-4bc4-82df-fc6abbce9577 tempest-VolumesTestJSON-414243818 tempest-VolumesTestJSON-414243818-project] Calling method '.version_select at 0x7fe0d4507ee0>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:50.961012 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-ee2c931d-a26f-4bc4-82df-fc6abbce9577 tempest-VolumesTestJSON-414243818 tempest-VolumesTestJSON-414243818-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/3d775fcf-f2b5-4c89-8f1b-623eed80562d" status: 200 len: 351 microversion: 2.1 time: 0.112859 Oct 03 14:51:50.962053 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 5/9] 10.222.0.46 () {58 vars in 1245 bytes} [Mon Oct 3 14:51:50 2022] GET /compute/v2.1/os-volumes/3d775fcf-f2b5-4c89-8f1b-623eed80562d => generated 351 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:51:52.961301 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-81676246-b51a-4d08-8903-62ce5bb112b9 tempest-VolumesTestJSON-414243818 tempest-VolumesTestJSON-414243818-project] Calling method '.version_select at 0x7fe0d4287a60>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:53.035519 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-81676246-b51a-4d08-8903-62ce5bb112b9 tempest-VolumesTestJSON-414243818 tempest-VolumesTestJSON-414243818-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/e1465252-e6a5-4946-be47-bdc5769e3b57" status: 200 len: 351 microversion: 2.1 time: 0.079204 Oct 03 14:51:53.046797 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 5/10] 10.222.0.46 () {58 vars in 1245 bytes} [Mon Oct 3 14:51:52 2022] GET /compute/v2.1/os-volumes/e1465252-e6a5-4946-be47-bdc5769e3b57 => generated 351 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:51:54.779666 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-3e01489c-f300-4369-b74d-51b9b06ac811 tempest-VolumesTestJSON-414243818 tempest-VolumesTestJSON-414243818-project] Calling method '.version_select at 0x7fe0d423a700>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:54.945925 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-3e01489c-f300-4369-b74d-51b9b06ac811 tempest-VolumesTestJSON-414243818 tempest-VolumesTestJSON-414243818-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/7642bee8-3593-4d20-9130-89d137a01200" status: 200 len: 350 microversion: 2.1 time: 0.168366 Oct 03 14:51:54.947183 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 6/11] 10.222.0.46 () {58 vars in 1245 bytes} [Mon Oct 3 14:51:54 2022] GET /compute/v2.1/os-volumes/7642bee8-3593-4d20-9130-89d137a01200 => generated 350 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:51:54.971415 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-dcd6f20a-75c3-41de-b68b-634a37392f3d tempest-VolumesTestJSON-414243818 tempest-VolumesTestJSON-414243818-project] Calling method '.version_select at 0x7fe0d42324c0>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:55.295160 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-dcd6f20a-75c3-41de-b68b-634a37392f3d tempest-VolumesTestJSON-414243818 tempest-VolumesTestJSON-414243818-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.338078 Oct 03 14:51:55.304990 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 6/12] 10.222.0.46 () {58 vars in 1134 bytes} [Mon Oct 3 14:51:54 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:55.322978 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-bcaaa54c-e246-4ec8-afbf-a4c4b6635bd1 tempest-VolumesTestJSON-414243818 tempest-VolumesTestJSON-414243818-project] Calling method '.version_select at 0x7fe0d42dc820>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:55.510529 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-bcaaa54c-e246-4ec8-afbf-a4c4b6635bd1 tempest-VolumesTestJSON-414243818 tempest-VolumesTestJSON-414243818-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.198497 Oct 03 14:51:55.511672 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 7/13] 10.222.0.46 () {58 vars in 1149 bytes} [Mon Oct 3 14:51:55 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:51:55.526739 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-7722e698-864f-49b0-bc13-2e404196bbbe tempest-VolumesTestJSON-414243818 tempest-VolumesTestJSON-414243818-project] Calling method '.version_select at 0x7fe0d4235a60>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:55.731951 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-7722e698-864f-49b0-bc13-2e404196bbbe tempest-VolumesTestJSON-414243818 tempest-VolumesTestJSON-414243818-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.209456 Oct 03 14:51:55.732523 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 7/14] 10.222.0.46 () {58 vars in 1134 bytes} [Mon Oct 3 14:51:55 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:55.746825 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-152b05a9-50f0-42e7-897f-a02dea4c3d7b tempest-VolumesTestJSON-414243818 tempest-VolumesTestJSON-414243818-project] Calling method '.version_select at 0x7fe0d423ac10>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:55.994650 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-152b05a9-50f0-42e7-897f-a02dea4c3d7b tempest-VolumesTestJSON-414243818 tempest-VolumesTestJSON-414243818-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.250763 Oct 03 14:51:55.997837 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 8/15] 10.222.0.46 () {58 vars in 1167 bytes} [Mon Oct 3 14:51:55 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:51:56.012457 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-b041b617-f78c-490a-ac94-c2eb65712ec4 tempest-VolumesTestJSON-414243818 tempest-VolumesTestJSON-414243818-project] Calling method '.version_select at 0x7fe0d42358b0>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:56.196019 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-b041b617-f78c-490a-ac94-c2eb65712ec4 tempest-VolumesTestJSON-414243818 tempest-VolumesTestJSON-414243818-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.187824 Oct 03 14:51:56.196701 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 8/16] 10.222.0.46 () {58 vars in 1170 bytes} [Mon Oct 3 14:51:56 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:51:56.212548 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-e38af410-11f0-4386-82e4-b7840d32afea tempest-VolumesTestJSON-414243818 tempest-VolumesTestJSON-414243818-project] Calling method '.version_select at 0x7fe0d42e5f70>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:56.472242 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-e38af410-11f0-4386-82e4-b7840d32afea tempest-VolumesTestJSON-414243818 tempest-VolumesTestJSON-414243818-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.265603 Oct 03 14:51:56.472901 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 9/17] 10.222.0.46 () {58 vars in 1155 bytes} [Mon Oct 3 14:51:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:56.487882 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-90b86a7d-963f-4e55-bd7e-61f24df798d5 tempest-VolumesTestJSON-414243818 tempest-VolumesTestJSON-414243818-project] Calling method '.version_select at 0x7fe0d4232310>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:56.726535 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-90b86a7d-963f-4e55-bd7e-61f24df798d5 tempest-VolumesTestJSON-414243818 tempest-VolumesTestJSON-414243818-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.243246 Oct 03 14:51:56.728271 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 9/18] 10.222.0.46 () {58 vars in 1188 bytes} [Mon Oct 3 14:51:56 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:51:56.756816 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-d3766ce8-ed49-48ac-b1dc-e40816b0e693 tempest-VolumesTestJSON-414243818 tempest-VolumesTestJSON-414243818-project] Calling method '.version_select at 0x7fe0d423adc0>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:56.958828 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-d3766ce8-ed49-48ac-b1dc-e40816b0e693 tempest-VolumesTestJSON-414243818 tempest-VolumesTestJSON-414243818-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.220945 Oct 03 14:51:56.959653 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 10/19] 10.222.0.46 () {58 vars in 1155 bytes} [Mon Oct 3 14:51:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:00.641335 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-2be734b3-db4a-40fd-b37f-c16be84e37b9 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Action: 'create', calling method: .version_select at 0x7fe0d4287c10>, body: {"keypair": {"name": "tempest-keypair-1117189096", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDudRiJgWduy7VdpNRomXpkubb/rVp5McrKmTXDsbFkKs3UYlBQRg4jWVOqWZ2xMY27RSz1q94L3bSgubOGGf1eOchbLbySOUUIFI7Rpj4IMlEKRBhzOED3Vb62qJPZjlA=="}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:00.851267 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-2be734b3-db4a-40fd-b37f-c16be84e37b9 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Getting quotas for project f441c0592cd146d3be851ac96cbc49dc. Resources: {'key_pairs'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:52:00.875625 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-2be734b3-db4a-40fd-b37f-c16be84e37b9 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Getting quotas for user 89c747f18b434e469ae61755e9f639ca and project f441c0592cd146d3be851ac96cbc49dc. Resources: {'key_pairs'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:52:00.987821 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-2be734b3-db4a-40fd-b37f-c16be84e37b9 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.262640 Oct 03 14:52:00.988932 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 10/20] 10.222.0.46 () {60 vars in 1159 bytes} [Mon Oct 3 14:51:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:52:05.345658 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-e6f95bf3-347c-47ad-87ee-61037eebcb00 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-455587249", "imageRef": "add7a872-2ca1-4366-9a93-f0663fdb297b", "flavorRef": "452", "networks": [{"uuid": "1a822274-e0ca-4ff0-95b8-688fdc218651"}]}} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:05.546645 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.network.neutron [None req-e6f95bf3-347c-47ad-87ee-61037eebcb00 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] validate_networks() for [('1a822274-e0ca-4ff0-95b8-688fdc218651', None, None, None, None, None)] {{(pid=126851) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:52:05.631042 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-6a80afcd-0eca-4065-a7f0-7b79b2edc697 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2013197470", "imageRef": "add7a872-2ca1-4366-9a93-f0663fdb297b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3b88fdf3-b260-41ad-9765-7cbb7b33b8ed"}], "security_groups": [{"name": "tempest-securitygroup--1963255663"}], "key_name": "tempest-keypair-1117189096", "user_data": "}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:06.481691 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.network.neutron [None req-6a80afcd-0eca-4065-a7f0-7b79b2edc697 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] validate_networks() for [('3b88fdf3-b260-41ad-9765-7cbb7b33b8ed', None, None, None, None, None)] {{(pid=126852) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:52:07.230713 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-e6f95bf3-347c-47ad-87ee-61037eebcb00 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Flavor limits 0:0:0 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:52:07.231395 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-e6f95bf3-347c-47ad-87ee-61037eebcb00 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Image limits 0:0:0 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:52:07.232047 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-e6f95bf3-347c-47ad-87ee-61037eebcb00 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Flavor pref 0:0:0 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:52:07.232986 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-e6f95bf3-347c-47ad-87ee-61037eebcb00 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Image pref 0:0:0 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:52:07.233421 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-e6f95bf3-347c-47ad-87ee-61037eebcb00 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:52:07.262128 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e6f95bf3-347c-47ad-87ee-61037eebcb00 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:07.262634 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e6f95bf3-347c-47ad-87ee-61037eebcb00 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:07.263078 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e6f95bf3-347c-47ad-87ee-61037eebcb00 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:07.263830 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e6f95bf3-347c-47ad-87ee-61037eebcb00 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:07.264282 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e6f95bf3-347c-47ad-87ee-61037eebcb00 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:07.264704 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e6f95bf3-347c-47ad-87ee-61037eebcb00 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:07.325975 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.quota [None req-e6f95bf3-347c-47ad-87ee-61037eebcb00 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Getting quotas for project 2e3b8c8420474d9397a3578350b9eacf. Resources: {'ram', 'instances', 'cores'} {{(pid=126851) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:52:07.334541 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.quota [None req-e6f95bf3-347c-47ad-87ee-61037eebcb00 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Getting quotas for user 913c969eb6274750aef880400a74e637 and project 2e3b8c8420474d9397a3578350b9eacf. Resources: {'ram', 'instances', 'cores'} {{(pid=126851) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:52:07.349477 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-e6f95bf3-347c-47ad-87ee-61037eebcb00 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Going to run 1 instances... {{(pid=126851) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:52:07.355726 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-e6f95bf3-347c-47ad-87ee-61037eebcb00 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='add7a872-2ca1-4366-9a93-f0663fdb297b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126851) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:52:07.519873 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-e6f95bf3-347c-47ad-87ee-61037eebcb00 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.688050 Oct 03 14:52:07.529596 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 11/21] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 3 14:52:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:52:07.994279 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-a73ef5ea-0b23-49fe-aac4-8a5592528a0c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1517865859", "imageRef": "add7a872-2ca1-4366-9a93-f0663fdb297b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:08.132069 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.network.neutron [None req-a73ef5ea-0b23-49fe-aac4-8a5592528a0c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] validate_networks() for [('a4c53322-c54a-4ca9-801c-f9a07dbbe7a2', None, None, None, None, None)] {{(pid=126851) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:52:08.991390 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-a73ef5ea-0b23-49fe-aac4-8a5592528a0c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Flavor limits 0:0:0 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:52:08.992589 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-a73ef5ea-0b23-49fe-aac4-8a5592528a0c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Image limits 0:0:0 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:52:08.993217 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-a73ef5ea-0b23-49fe-aac4-8a5592528a0c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Flavor pref 0:0:0 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:52:08.993814 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-a73ef5ea-0b23-49fe-aac4-8a5592528a0c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Image pref 0:0:0 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:52:08.994403 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-a73ef5ea-0b23-49fe-aac4-8a5592528a0c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:52:09.005675 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a73ef5ea-0b23-49fe-aac4-8a5592528a0c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:09.006425 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a73ef5ea-0b23-49fe-aac4-8a5592528a0c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:09.007077 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a73ef5ea-0b23-49fe-aac4-8a5592528a0c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:09.007985 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a73ef5ea-0b23-49fe-aac4-8a5592528a0c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:09.008601 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a73ef5ea-0b23-49fe-aac4-8a5592528a0c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:09.009275 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a73ef5ea-0b23-49fe-aac4-8a5592528a0c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:09.033230 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.quota [None req-a73ef5ea-0b23-49fe-aac4-8a5592528a0c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Getting quotas for project 83b495f3cb9b437d9572f4d33327fbf7. Resources: {'ram', 'instances', 'cores'} {{(pid=126851) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:52:09.038940 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.quota [None req-a73ef5ea-0b23-49fe-aac4-8a5592528a0c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Getting quotas for user 335dd8706d4c402e98605479b57d059a and project 83b495f3cb9b437d9572f4d33327fbf7. Resources: {'ram', 'instances', 'cores'} {{(pid=126851) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:52:09.055909 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-a73ef5ea-0b23-49fe-aac4-8a5592528a0c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Going to run 1 instances... {{(pid=126851) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:52:09.078383 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-a73ef5ea-0b23-49fe-aac4-8a5592528a0c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='add7a872-2ca1-4366-9a93-f0663fdb297b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126851) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:52:09.183797 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-a73ef5ea-0b23-49fe-aac4-8a5592528a0c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.640530 Oct 03 14:52:09.184754 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 12/22] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 3 14:52:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 1654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:52:09.201429 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-45d2be57-e4f6-46e3-8c54-ad4c41b6f8fe tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:09.202289 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-45d2be57-e4f6-46e3-8c54-ad4c41b6f8fe tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:09.430415 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-45d2be57-e4f6-46e3-8c54-ad4c41b6f8fe tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:09.472500 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-45d2be57-e4f6-46e3-8c54-ad4c41b6f8fe tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1214 microversion: 2.1 time: 0.283249 Oct 03 14:52:09.475332 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 13/23] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:09 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1214 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:09.502539 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-13ae1272-3d75-433a-9b03-515522d43bd6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:09.503475 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-13ae1272-3d75-433a-9b03-515522d43bd6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:09.696541 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-13ae1272-3d75-433a-9b03-515522d43bd6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:09.715814 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-13ae1272-3d75-433a-9b03-515522d43bd6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3" status: 200 len: 1222 microversion: 2.1 time: 0.238193 Oct 03 14:52:09.716691 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 14/24] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:09 2022] GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3 => generated 1222 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:09.916112 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-6a80afcd-0eca-4065-a7f0-7b79b2edc697 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Flavor limits 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:52:09.916112 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-6a80afcd-0eca-4065-a7f0-7b79b2edc697 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Image limits 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:52:09.916755 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-6a80afcd-0eca-4065-a7f0-7b79b2edc697 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Flavor pref 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:52:09.916755 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-6a80afcd-0eca-4065-a7f0-7b79b2edc697 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Image pref 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:52:09.917088 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-6a80afcd-0eca-4065-a7f0-7b79b2edc697 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:52:09.933257 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6a80afcd-0eca-4065-a7f0-7b79b2edc697 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:09.933697 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6a80afcd-0eca-4065-a7f0-7b79b2edc697 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:09.934130 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6a80afcd-0eca-4065-a7f0-7b79b2edc697 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:09.934880 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6a80afcd-0eca-4065-a7f0-7b79b2edc697 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:09.935303 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6a80afcd-0eca-4065-a7f0-7b79b2edc697 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:09.935722 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6a80afcd-0eca-4065-a7f0-7b79b2edc697 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:09.955565 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-f22e6cbc-b46f-4abd-af1e-b06c04dfe0f5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-413881656", "imageRef": "add7a872-2ca1-4366-9a93-f0663fdb297b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:10.002968 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-6a80afcd-0eca-4065-a7f0-7b79b2edc697 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Getting quotas for project f441c0592cd146d3be851ac96cbc49dc. Resources: {'ram', 'instances', 'cores'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:52:10.009391 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-6a80afcd-0eca-4065-a7f0-7b79b2edc697 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Getting quotas for user 89c747f18b434e469ae61755e9f639ca and project f441c0592cd146d3be851ac96cbc49dc. Resources: {'ram', 'instances', 'cores'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:52:10.040510 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-6a80afcd-0eca-4065-a7f0-7b79b2edc697 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Going to run 1 instances... {{(pid=126852) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:52:10.043778 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-6a80afcd-0eca-4065-a7f0-7b79b2edc697 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='add7a872-2ca1-4366-9a93-f0663fdb297b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:52:10.046369 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.network.neutron [None req-f22e6cbc-b46f-4abd-af1e-b06c04dfe0f5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] validate_networks() for [('a4c53322-c54a-4ca9-801c-f9a07dbbe7a2', None, None, None, None, None)] {{(pid=126851) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:52:10.201804 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-6a80afcd-0eca-4065-a7f0-7b79b2edc697 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.573218 Oct 03 14:52:10.203043 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 11/25] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 3 14:52:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 4578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:52:10.215120 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-a30167e6-bb4a-4883-8915-5848925a3e37 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:10.216422 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-a30167e6-bb4a-4883-8915-5848925a3e37 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:10.368138 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-a30167e6-bb4a-4883-8915-5848925a3e37 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:10.392192 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-a30167e6-bb4a-4883-8915-5848925a3e37 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 200 len: 1242 microversion: 2.1 time: 0.179559 Oct 03 14:52:10.393627 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 12/26] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:10 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 1242 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:10.514016 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-b83517b9-be0d-414e-8301-7ea903087db6 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:10.515649 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-b83517b9-be0d-414e-8301-7ea903087db6 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:10.538713 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b83517b9-be0d-414e-8301-7ea903087db6 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:10.539396 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b83517b9-be0d-414e-8301-7ea903087db6 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:10.539879 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b83517b9-be0d-414e-8301-7ea903087db6 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:10.540935 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b83517b9-be0d-414e-8301-7ea903087db6 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:10.541685 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b83517b9-be0d-414e-8301-7ea903087db6 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:10.542369 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b83517b9-be0d-414e-8301-7ea903087db6 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:10.901406 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-b83517b9-be0d-414e-8301-7ea903087db6 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:10.921368 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-b83517b9-be0d-414e-8301-7ea903087db6 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1218 microversion: 2.1 time: 0.413931 Oct 03 14:52:10.922079 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 13/27] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:10 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1218 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:11.342337 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-b92d3b23-480b-4cc3-a352-ae4414390ad6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Action: 'create', calling method: .version_select at 0x7fe0d3891af0>, body: {"keypair": {"name": "tempest-keypair-931744686", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4lGPVYSRP/CzpIqKOom1O+K/SgbqI4cvidEWNFgoZEAx/wxIJ4GGZ7vUZWmo9sWqo8xJ6SJj20S47U9SmAupa0WJRgoq5W1NEMr0sSuu92NnrQFPcbQfkeEPDq7iGmBA=="}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:11.406259 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-b92d3b23-480b-4cc3-a352-ae4414390ad6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Getting quotas for project 7f48b2441eec48c4ac784844e475a9e9. Resources: {'key_pairs'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:52:11.420625 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-b92d3b23-480b-4cc3-a352-ae4414390ad6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Getting quotas for user 9e5325f010ae4359bd6b514a1995614d and project 7f48b2441eec48c4ac784844e475a9e9. Resources: {'key_pairs'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:52:11.544283 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-b92d3b23-480b-4cc3-a352-ae4414390ad6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.618738 Oct 03 14:52:11.545868 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 14/28] 10.222.0.46 () {62 vars in 1200 bytes} [Mon Oct 3 14:52:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 621 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 03 14:52:11.866098 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-f22e6cbc-b46f-4abd-af1e-b06c04dfe0f5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Flavor limits 0:0:0 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:52:11.866623 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-f22e6cbc-b46f-4abd-af1e-b06c04dfe0f5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Image limits 0:0:0 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:52:11.867204 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-f22e6cbc-b46f-4abd-af1e-b06c04dfe0f5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Flavor pref 0:0:0 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:52:11.867750 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-f22e6cbc-b46f-4abd-af1e-b06c04dfe0f5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Image pref 0:0:0 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:52:11.868261 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-f22e6cbc-b46f-4abd-af1e-b06c04dfe0f5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:52:11.908242 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f22e6cbc-b46f-4abd-af1e-b06c04dfe0f5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:11.911155 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f22e6cbc-b46f-4abd-af1e-b06c04dfe0f5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:11.913619 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f22e6cbc-b46f-4abd-af1e-b06c04dfe0f5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:11.919628 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f22e6cbc-b46f-4abd-af1e-b06c04dfe0f5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:11.924188 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f22e6cbc-b46f-4abd-af1e-b06c04dfe0f5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:11.924916 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f22e6cbc-b46f-4abd-af1e-b06c04dfe0f5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:11.994788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.quota [None req-f22e6cbc-b46f-4abd-af1e-b06c04dfe0f5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Getting quotas for project 83b495f3cb9b437d9572f4d33327fbf7. Resources: {'ram', 'instances', 'cores'} {{(pid=126851) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:52:12.012012 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.quota [None req-f22e6cbc-b46f-4abd-af1e-b06c04dfe0f5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Getting quotas for user 335dd8706d4c402e98605479b57d059a and project 83b495f3cb9b437d9572f4d33327fbf7. Resources: {'ram', 'instances', 'cores'} {{(pid=126851) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:52:12.085441 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-f22e6cbc-b46f-4abd-af1e-b06c04dfe0f5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Going to run 1 instances... {{(pid=126851) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:52:12.088433 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-f22e6cbc-b46f-4abd-af1e-b06c04dfe0f5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='add7a872-2ca1-4366-9a93-f0663fdb297b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126851) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:52:12.203607 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-f22e6cbc-b46f-4abd-af1e-b06c04dfe0f5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.250513 Oct 03 14:52:12.204498 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 15/29] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 3 14:52:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 2256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:52:12.229309 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-97765158-a958-461f-aee1-54ef09a0af3c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Action: 'create', calling method: .version_select at 0x7fe0d389f430>, body: {"keypair": {"name": "tempest-keypair-2055196", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfXiUnnoIJak+Z04dESUyAKEYEHE/WAQyrSNxph6k3odhsa2TEauvJ19XEa0UXf/PE+VY+N3O+pbfk9mCbpG/nA71H271zgcqk4yQYT7/UWEDjKfBjLcTt7XaQhNmxdSg=="}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:12.232659 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-dfda86b8-fcbf-4588-88f7-4c3930be46a4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:12.234159 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-dfda86b8-fcbf-4588-88f7-4c3930be46a4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:12.246950 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dfda86b8-fcbf-4588-88f7-4c3930be46a4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:12.247624 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dfda86b8-fcbf-4588-88f7-4c3930be46a4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:12.248221 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dfda86b8-fcbf-4588-88f7-4c3930be46a4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:12.249098 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dfda86b8-fcbf-4588-88f7-4c3930be46a4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:12.249787 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dfda86b8-fcbf-4588-88f7-4c3930be46a4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:12.250360 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dfda86b8-fcbf-4588-88f7-4c3930be46a4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:12.324988 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-97765158-a958-461f-aee1-54ef09a0af3c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Getting quotas for project 8cf070b7d6ff419392acaddbbee1e242. Resources: {'key_pairs'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:52:12.346810 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-97765158-a958-461f-aee1-54ef09a0af3c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Getting quotas for user 0be78e1abb3947a2ac5881b9fd2f6fae and project 8cf070b7d6ff419392acaddbbee1e242. Resources: {'key_pairs'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:52:12.454990 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-97765158-a958-461f-aee1-54ef09a0af3c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 0.905514 Oct 03 14:52:12.455861 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 15/30] 10.222.0.46 () {60 vars in 1159 bytes} [Mon Oct 3 14:52:11 2022] POST /compute/v2.1/os-keypairs => generated 383 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:52:12.467988 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-66c49e1b-ef3e-4c8c-b81e-92ed36c7bece tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:12.470614 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-66c49e1b-ef3e-4c8c-b81e-92ed36c7bece tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:12.489450 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-66c49e1b-ef3e-4c8c-b81e-92ed36c7bece tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:12.491204 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-66c49e1b-ef3e-4c8c-b81e-92ed36c7bece tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:12.492042 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-66c49e1b-ef3e-4c8c-b81e-92ed36c7bece tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:12.496286 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-66c49e1b-ef3e-4c8c-b81e-92ed36c7bece tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:12.498401 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-66c49e1b-ef3e-4c8c-b81e-92ed36c7bece tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:12.502220 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-66c49e1b-ef3e-4c8c-b81e-92ed36c7bece tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:12.794156 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-66c49e1b-ef3e-4c8c-b81e-92ed36c7bece tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:12.818716 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-66c49e1b-ef3e-4c8c-b81e-92ed36c7bece tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1266 microversion: 2.1 time: 0.354557 Oct 03 14:52:12.827199 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 16/31] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:12 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1266 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:12.852699 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-568fbba5-6428-48ec-99c7-4028d9290ecf tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:12.858357 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-568fbba5-6428-48ec-99c7-4028d9290ecf tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:13.170700 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-568fbba5-6428-48ec-99c7-4028d9290ecf tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:13.180776 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-568fbba5-6428-48ec-99c7-4028d9290ecf tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1221 microversion: 2.1 time: 0.350840 Oct 03 14:52:13.189856 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 17/32] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:12 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1221 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:13.193115 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-dfda86b8-fcbf-4588-88f7-4c3930be46a4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:13.221798 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-dfda86b8-fcbf-4588-88f7-4c3930be46a4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 200 len: 1238 microversion: 2.1 time: 1.004571 Oct 03 14:52:13.223280 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 16/33] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:12 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 1238 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:13.852604 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-73558959-6562-423b-80bb-411f76627d0d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:13.854036 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-73558959-6562-423b-80bb-411f76627d0d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:13.869943 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-73558959-6562-423b-80bb-411f76627d0d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:13.871842 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-73558959-6562-423b-80bb-411f76627d0d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:13.872472 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-73558959-6562-423b-80bb-411f76627d0d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:13.874938 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-73558959-6562-423b-80bb-411f76627d0d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:13.875601 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-73558959-6562-423b-80bb-411f76627d0d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:13.876634 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-73558959-6562-423b-80bb-411f76627d0d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:14.132628 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-73558959-6562-423b-80bb-411f76627d0d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:14.153522 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-73558959-6562-423b-80bb-411f76627d0d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1272 microversion: 2.1 time: 0.305326 Oct 03 14:52:14.164917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 18/34] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:13 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1272 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:14.207926 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-60afe7af-d2e2-4be0-a66e-28b22a3acd2c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:14.209126 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-60afe7af-d2e2-4be0-a66e-28b22a3acd2c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:14.219916 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-60afe7af-d2e2-4be0-a66e-28b22a3acd2c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:14.225068 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-60afe7af-d2e2-4be0-a66e-28b22a3acd2c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:14.226546 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-60afe7af-d2e2-4be0-a66e-28b22a3acd2c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:14.228580 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-60afe7af-d2e2-4be0-a66e-28b22a3acd2c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:14.232501 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-60afe7af-d2e2-4be0-a66e-28b22a3acd2c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:14.233116 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-60afe7af-d2e2-4be0-a66e-28b22a3acd2c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:14.251638 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-38afcc5c-0361-4783-a9a5-0e3fc152c658 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:14.252635 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-38afcc5c-0361-4783-a9a5-0e3fc152c658 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:14.261986 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-38afcc5c-0361-4783-a9a5-0e3fc152c658 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:14.281303 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-38afcc5c-0361-4783-a9a5-0e3fc152c658 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:14.283655 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-38afcc5c-0361-4783-a9a5-0e3fc152c658 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:14.290447 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-38afcc5c-0361-4783-a9a5-0e3fc152c658 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:14.291122 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-38afcc5c-0361-4783-a9a5-0e3fc152c658 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:14.294443 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-38afcc5c-0361-4783-a9a5-0e3fc152c658 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:14.654849 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-60afe7af-d2e2-4be0-a66e-28b22a3acd2c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:14.664863 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-60afe7af-d2e2-4be0-a66e-28b22a3acd2c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1217 microversion: 2.1 time: 0.461873 Oct 03 14:52:14.668093 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 17/35] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:14 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1217 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:15.151116 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-38afcc5c-0361-4783-a9a5-0e3fc152c658 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:15.159060 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-38afcc5c-0361-4783-a9a5-0e3fc152c658 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 200 len: 1294 microversion: 2.1 time: 0.911135 Oct 03 14:52:15.159635 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 19/36] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:14 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 1294 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:15.189302 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-7f8685ae-a569-404f-9be3-54e8bcc63b1a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:15.189957 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-7f8685ae-a569-404f-9be3-54e8bcc63b1a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:15.206508 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7f8685ae-a569-404f-9be3-54e8bcc63b1a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:15.208686 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7f8685ae-a569-404f-9be3-54e8bcc63b1a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:15.210271 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7f8685ae-a569-404f-9be3-54e8bcc63b1a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:15.214159 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7f8685ae-a569-404f-9be3-54e8bcc63b1a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:15.214656 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7f8685ae-a569-404f-9be3-54e8bcc63b1a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:15.216881 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7f8685ae-a569-404f-9be3-54e8bcc63b1a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:15.603268 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-7f8685ae-a569-404f-9be3-54e8bcc63b1a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:15.613073 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-7f8685ae-a569-404f-9be3-54e8bcc63b1a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1272 microversion: 2.1 time: 0.427680 Oct 03 14:52:15.620240 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 18/37] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:15 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1272 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:15.704566 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-a873c263-423f-4d00-922b-49424f712e6c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:15.705309 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-a873c263-423f-4d00-922b-49424f712e6c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:15.747896 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a873c263-423f-4d00-922b-49424f712e6c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:15.748489 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a873c263-423f-4d00-922b-49424f712e6c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:15.748946 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a873c263-423f-4d00-922b-49424f712e6c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:15.762982 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a873c263-423f-4d00-922b-49424f712e6c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:15.767864 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a873c263-423f-4d00-922b-49424f712e6c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:15.768331 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a873c263-423f-4d00-922b-49424f712e6c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:16.185352 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-ad5fb96a-15bb-4852-afcd-dfd09c0fe8f2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:16.186066 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-ad5fb96a-15bb-4852-afcd-dfd09c0fe8f2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:16.210469 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ad5fb96a-15bb-4852-afcd-dfd09c0fe8f2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:16.221325 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ad5fb96a-15bb-4852-afcd-dfd09c0fe8f2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:16.223627 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ad5fb96a-15bb-4852-afcd-dfd09c0fe8f2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:16.229859 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ad5fb96a-15bb-4852-afcd-dfd09c0fe8f2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:16.232462 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ad5fb96a-15bb-4852-afcd-dfd09c0fe8f2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:16.236628 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ad5fb96a-15bb-4852-afcd-dfd09c0fe8f2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:16.667637 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-a873c263-423f-4d00-922b-49424f712e6c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:16.681547 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-ad5fb96a-15bb-4852-afcd-dfd09c0fe8f2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:16.688481 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-a873c263-423f-4d00-922b-49424f712e6c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1281 microversion: 2.1 time: 0.989895 Oct 03 14:52:16.695589 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-ad5fb96a-15bb-4852-afcd-dfd09c0fe8f2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 200 len: 1300 microversion: 2.1 time: 0.515992 Oct 03 14:52:16.698358 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 19/38] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:16 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 1300 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:16.705346 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 20/39] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:15 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1281 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:16.714951 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-0fac04d7-08c3-4c5d-bfe4-f5472c46d60f tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:16.715582 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-0fac04d7-08c3-4c5d-bfe4-f5472c46d60f tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:16.761695 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0fac04d7-08c3-4c5d-bfe4-f5472c46d60f tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:16.762280 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0fac04d7-08c3-4c5d-bfe4-f5472c46d60f tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:16.762729 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0fac04d7-08c3-4c5d-bfe4-f5472c46d60f tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:16.763476 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0fac04d7-08c3-4c5d-bfe4-f5472c46d60f tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:16.764146 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0fac04d7-08c3-4c5d-bfe4-f5472c46d60f tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:16.764447 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0fac04d7-08c3-4c5d-bfe4-f5472c46d60f tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:17.452619 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-0fac04d7-08c3-4c5d-bfe4-f5472c46d60f tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:17.473338 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-0fac04d7-08c3-4c5d-bfe4-f5472c46d60f tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1272 microversion: 2.1 time: 0.768064 Oct 03 14:52:17.474548 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 20/40] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:16 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1272 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:17.716985 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-b6623b9e-9520-4abf-b544-b6b6ac8ba2a5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:17.725038 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-a4b9996e-e848-4232-bd2c-53abc08e70a6 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:17.725421 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-b6623b9e-9520-4abf-b544-b6b6ac8ba2a5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:17.729433 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-a4b9996e-e848-4232-bd2c-53abc08e70a6 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:17.743414 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a4b9996e-e848-4232-bd2c-53abc08e70a6 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:17.756494 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b6623b9e-9520-4abf-b544-b6b6ac8ba2a5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:17.757005 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b6623b9e-9520-4abf-b544-b6b6ac8ba2a5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:17.757456 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b6623b9e-9520-4abf-b544-b6b6ac8ba2a5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:17.762048 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b6623b9e-9520-4abf-b544-b6b6ac8ba2a5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:17.762615 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a4b9996e-e848-4232-bd2c-53abc08e70a6 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:17.763347 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a4b9996e-e848-4232-bd2c-53abc08e70a6 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:17.763887 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b6623b9e-9520-4abf-b544-b6b6ac8ba2a5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:17.764396 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b6623b9e-9520-4abf-b544-b6b6ac8ba2a5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:17.766592 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a4b9996e-e848-4232-bd2c-53abc08e70a6 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:17.774854 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a4b9996e-e848-4232-bd2c-53abc08e70a6 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:17.777161 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a4b9996e-e848-4232-bd2c-53abc08e70a6 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:18.078229 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-a4b9996e-e848-4232-bd2c-53abc08e70a6 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:18.104948 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-a4b9996e-e848-4232-bd2c-53abc08e70a6 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 200 len: 1300 microversion: 2.1 time: 0.378728 Oct 03 14:52:18.125488 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 21/41] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:17 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 1300 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:18.200011 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-b6623b9e-9520-4abf-b544-b6b6ac8ba2a5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:18.210498 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-b6623b9e-9520-4abf-b544-b6b6ac8ba2a5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1279 microversion: 2.1 time: 0.498137 Oct 03 14:52:18.211805 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 21/42] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:17 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1279 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:18.505430 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-d61a6f1a-991f-4352-a381-c316b1565901 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:18.506501 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-d61a6f1a-991f-4352-a381-c316b1565901 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:18.525100 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d61a6f1a-991f-4352-a381-c316b1565901 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:18.527440 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d61a6f1a-991f-4352-a381-c316b1565901 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:18.529987 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d61a6f1a-991f-4352-a381-c316b1565901 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:18.537381 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d61a6f1a-991f-4352-a381-c316b1565901 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:18.538109 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d61a6f1a-991f-4352-a381-c316b1565901 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:18.539260 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d61a6f1a-991f-4352-a381-c316b1565901 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:19.136601 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-ae3a5a40-7c80-4199-b14f-e570244c191f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:19.142506 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-ae3a5a40-7c80-4199-b14f-e570244c191f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:19.159032 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ae3a5a40-7c80-4199-b14f-e570244c191f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:19.160913 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ae3a5a40-7c80-4199-b14f-e570244c191f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:19.166461 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ae3a5a40-7c80-4199-b14f-e570244c191f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:19.170883 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ae3a5a40-7c80-4199-b14f-e570244c191f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:19.172953 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ae3a5a40-7c80-4199-b14f-e570244c191f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:19.174362 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ae3a5a40-7c80-4199-b14f-e570244c191f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:19.567255 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-d61a6f1a-991f-4352-a381-c316b1565901 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:19.589155 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-d61a6f1a-991f-4352-a381-c316b1565901 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1314 microversion: 2.1 time: 1.091653 Oct 03 14:52:19.601752 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 22/43] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:18 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1314 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:19.613025 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-1f5d5e2c-4f97-49ff-878b-db83776728dd tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:19.614039 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-1f5d5e2c-4f97-49ff-878b-db83776728dd tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:19.622091 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1f5d5e2c-4f97-49ff-878b-db83776728dd tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:19.622687 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1f5d5e2c-4f97-49ff-878b-db83776728dd tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:19.623391 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1f5d5e2c-4f97-49ff-878b-db83776728dd tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:19.624203 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1f5d5e2c-4f97-49ff-878b-db83776728dd tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:19.624756 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1f5d5e2c-4f97-49ff-878b-db83776728dd tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:19.625403 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1f5d5e2c-4f97-49ff-878b-db83776728dd tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:19.795522 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-1f5d5e2c-4f97-49ff-878b-db83776728dd tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:19.810810 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-1f5d5e2c-4f97-49ff-878b-db83776728dd tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1279 microversion: 2.1 time: 0.205696 Oct 03 14:52:19.817647 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 23/44] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:19 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1279 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:19.830871 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-ae3a5a40-7c80-4199-b14f-e570244c191f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:19.854713 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-ae3a5a40-7c80-4199-b14f-e570244c191f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 200 len: 1300 microversion: 2.1 time: 0.722673 Oct 03 14:52:19.855608 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 22/45] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:19 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 1300 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:20.618935 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-84714943-b891-4bb4-9f2b-97ccf3c9af02 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:20.619671 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-84714943-b891-4bb4-9f2b-97ccf3c9af02 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:20.631980 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-84714943-b891-4bb4-9f2b-97ccf3c9af02 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:20.632478 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-84714943-b891-4bb4-9f2b-97ccf3c9af02 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:20.633000 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-84714943-b891-4bb4-9f2b-97ccf3c9af02 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:20.633691 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-84714943-b891-4bb4-9f2b-97ccf3c9af02 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:20.634317 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-84714943-b891-4bb4-9f2b-97ccf3c9af02 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:20.638639 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-84714943-b891-4bb4-9f2b-97ccf3c9af02 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:20.841644 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell0:SELECT=2 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:20.848050 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-616d58f8-97f0-48d5-979f-7c3d3f090dc3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:20.848711 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-616d58f8-97f0-48d5-979f-7c3d3f090dc3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:20.860900 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-616d58f8-97f0-48d5-979f-7c3d3f090dc3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:20.865435 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-616d58f8-97f0-48d5-979f-7c3d3f090dc3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:20.867522 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-616d58f8-97f0-48d5-979f-7c3d3f090dc3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:20.868288 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-616d58f8-97f0-48d5-979f-7c3d3f090dc3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:20.868767 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-616d58f8-97f0-48d5-979f-7c3d3f090dc3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:20.871128 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-616d58f8-97f0-48d5-979f-7c3d3f090dc3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:21.212670 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-84714943-b891-4bb4-9f2b-97ccf3c9af02 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:21.233671 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-84714943-b891-4bb4-9f2b-97ccf3c9af02 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1314 microversion: 2.1 time: 0.618384 Oct 03 14:52:21.255437 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 24/46] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:20 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1314 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:21.304625 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-04644509-5a4b-46f0-9de0-4ca4d87d8335 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:21.305349 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-04644509-5a4b-46f0-9de0-4ca4d87d8335 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:21.327544 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-04644509-5a4b-46f0-9de0-4ca4d87d8335 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:21.328099 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-04644509-5a4b-46f0-9de0-4ca4d87d8335 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:21.328550 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-04644509-5a4b-46f0-9de0-4ca4d87d8335 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:21.329326 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-04644509-5a4b-46f0-9de0-4ca4d87d8335 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:21.340270 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-04644509-5a4b-46f0-9de0-4ca4d87d8335 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:21.342008 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-04644509-5a4b-46f0-9de0-4ca4d87d8335 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:21.363560 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-616d58f8-97f0-48d5-979f-7c3d3f090dc3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:21.380234 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-616d58f8-97f0-48d5-979f-7c3d3f090dc3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1279 microversion: 2.1 time: 0.543356 Oct 03 14:52:21.383404 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 23/47] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:20 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1279 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:21.405279 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-5c8fac26-47d2-46d8-a6b9-9d97b0518075 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1412170450", "imageRef": "add7a872-2ca1-4366-9a93-f0663fdb297b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e62ce727-fdfc-4635-82f1-b266a0898b13"}], "security_groups": [{"name": "tempest-securitygroup--1953263755"}], "key_name": "tempest-keypair-931744686", "user_data": "}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:21.950144 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell0:SELECT=6 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:22.064157 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell0:SELECT=22 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:22.182284 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-04644509-5a4b-46f0-9de0-4ca4d87d8335 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:22.190481 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-04644509-5a4b-46f0-9de0-4ca4d87d8335 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 200 len: 1300 microversion: 2.1 time: 0.926791 Oct 03 14:52:22.196464 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 25/48] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:21 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 1300 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:22.203859 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-941be731-3f99-41bb-a7cf-99e59d9b4c41 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-43794123", "imageRef": "add7a872-2ca1-4366-9a93-f0663fdb297b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3de19230-35e5-430c-b606-8b501507ea36"}], "security_groups": [{"name": "tempest-securitygroup--418491937"}], "key_name": "tempest-keypair-2055196", "user_data": "}} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:22.654974 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.network.neutron [None req-941be731-3f99-41bb-a7cf-99e59d9b4c41 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] validate_networks() for [('3de19230-35e5-430c-b606-8b501507ea36', None, None, None, None, None)] {{(pid=126851) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:52:22.983733 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.network.neutron [None req-5c8fac26-47d2-46d8-a6b9-9d97b0518075 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] validate_networks() for [('e62ce727-fdfc-4635-82f1-b266a0898b13', None, None, None, None, None)] {{(pid=126852) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:52:23.179571 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell0:SELECT=22 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:25.125356 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-5c8fac26-47d2-46d8-a6b9-9d97b0518075 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Flavor limits 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:52:25.126812 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-5c8fac26-47d2-46d8-a6b9-9d97b0518075 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Image limits 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:52:25.127493 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-5c8fac26-47d2-46d8-a6b9-9d97b0518075 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Flavor pref 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:52:25.128186 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-5c8fac26-47d2-46d8-a6b9-9d97b0518075 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Image pref 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:52:25.129529 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-5c8fac26-47d2-46d8-a6b9-9d97b0518075 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:52:25.148110 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5c8fac26-47d2-46d8-a6b9-9d97b0518075 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:25.148616 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5c8fac26-47d2-46d8-a6b9-9d97b0518075 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:25.149060 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5c8fac26-47d2-46d8-a6b9-9d97b0518075 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:25.157816 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5c8fac26-47d2-46d8-a6b9-9d97b0518075 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:25.158360 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5c8fac26-47d2-46d8-a6b9-9d97b0518075 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:25.159179 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5c8fac26-47d2-46d8-a6b9-9d97b0518075 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:25.188051 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-941be731-3f99-41bb-a7cf-99e59d9b4c41 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Flavor limits 0:0:0 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:52:25.188897 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-941be731-3f99-41bb-a7cf-99e59d9b4c41 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Image limits 0:0:0 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:52:25.189674 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-941be731-3f99-41bb-a7cf-99e59d9b4c41 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Flavor pref 0:0:0 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:52:25.190396 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-941be731-3f99-41bb-a7cf-99e59d9b4c41 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Image pref 0:0:0 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:52:25.191893 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-941be731-3f99-41bb-a7cf-99e59d9b4c41 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:52:25.206294 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-941be731-3f99-41bb-a7cf-99e59d9b4c41 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:25.208514 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-941be731-3f99-41bb-a7cf-99e59d9b4c41 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:25.209424 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-941be731-3f99-41bb-a7cf-99e59d9b4c41 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:25.210461 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-941be731-3f99-41bb-a7cf-99e59d9b4c41 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:25.211468 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-941be731-3f99-41bb-a7cf-99e59d9b4c41 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:25.212603 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-941be731-3f99-41bb-a7cf-99e59d9b4c41 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:25.225382 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-5c8fac26-47d2-46d8-a6b9-9d97b0518075 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Getting quotas for project 7f48b2441eec48c4ac784844e475a9e9. Resources: {'ram', 'instances', 'cores'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:52:25.239904 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-5c8fac26-47d2-46d8-a6b9-9d97b0518075 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Getting quotas for user 9e5325f010ae4359bd6b514a1995614d and project 7f48b2441eec48c4ac784844e475a9e9. Resources: {'ram', 'instances', 'cores'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:52:25.244223 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.quota [None req-941be731-3f99-41bb-a7cf-99e59d9b4c41 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Getting quotas for project 8cf070b7d6ff419392acaddbbee1e242. Resources: {'ram', 'instances', 'cores'} {{(pid=126851) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:52:25.252340 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.quota [None req-941be731-3f99-41bb-a7cf-99e59d9b4c41 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Getting quotas for user 0be78e1abb3947a2ac5881b9fd2f6fae and project 8cf070b7d6ff419392acaddbbee1e242. Resources: {'ram', 'instances', 'cores'} {{(pid=126851) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:52:25.263224 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-5c8fac26-47d2-46d8-a6b9-9d97b0518075 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Going to run 1 instances... {{(pid=126852) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:52:25.266597 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-5c8fac26-47d2-46d8-a6b9-9d97b0518075 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='add7a872-2ca1-4366-9a93-f0663fdb297b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:52:25.286296 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-941be731-3f99-41bb-a7cf-99e59d9b4c41 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Going to run 1 instances... {{(pid=126851) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:52:25.291559 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-941be731-3f99-41bb-a7cf-99e59d9b4c41 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='add7a872-2ca1-4366-9a93-f0663fdb297b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126851) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:52:25.397618 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-5c8fac26-47d2-46d8-a6b9-9d97b0518075 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.012374 Oct 03 14:52:25.398740 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 24/49] 10.222.0.46 () {62 vars in 1188 bytes} [Mon Oct 3 14:52:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 4014 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 03 14:52:25.404009 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-7872a772-860d-448d-8a8b-4d991aad18bf tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:25.405041 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-7872a772-860d-448d-8a8b-4d991aad18bf tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:25.412320 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7872a772-860d-448d-8a8b-4d991aad18bf tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:25.412870 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7872a772-860d-448d-8a8b-4d991aad18bf tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:25.413316 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7872a772-860d-448d-8a8b-4d991aad18bf tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:25.414103 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7872a772-860d-448d-8a8b-4d991aad18bf tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:25.414556 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7872a772-860d-448d-8a8b-4d991aad18bf tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:25.415155 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7872a772-860d-448d-8a8b-4d991aad18bf tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:25.436938 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-941be731-3f99-41bb-a7cf-99e59d9b4c41 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.238580 Oct 03 14:52:25.453899 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 26/50] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 3 14:52:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 3256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:52:25.468987 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-b1baff03-6315-4a12-b6e5-4953a00f147b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:25.474947 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-b1baff03-6315-4a12-b6e5-4953a00f147b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:25.492292 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b1baff03-6315-4a12-b6e5-4953a00f147b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:25.517658 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b1baff03-6315-4a12-b6e5-4953a00f147b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:25.521297 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b1baff03-6315-4a12-b6e5-4953a00f147b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:25.522654 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b1baff03-6315-4a12-b6e5-4953a00f147b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:25.523437 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b1baff03-6315-4a12-b6e5-4953a00f147b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:25.524170 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b1baff03-6315-4a12-b6e5-4953a00f147b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:26.401003 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-7872a772-860d-448d-8a8b-4d991aad18bf tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:26.410139 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-7872a772-860d-448d-8a8b-4d991aad18bf tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1314 microversion: 2.1 time: 1.010088 Oct 03 14:52:26.419734 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 25/51] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:25 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1314 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:26.460284 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-122c39a1-0595-488d-b329-78859f6b30bc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:26.464223 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-122c39a1-0595-488d-b329-78859f6b30bc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:26.482271 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:26.506059 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-122c39a1-0595-488d-b329-78859f6b30bc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:26.507976 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-122c39a1-0595-488d-b329-78859f6b30bc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:26.508551 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-122c39a1-0595-488d-b329-78859f6b30bc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:26.511649 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-122c39a1-0595-488d-b329-78859f6b30bc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:26.515549 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-122c39a1-0595-488d-b329-78859f6b30bc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:26.516178 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-122c39a1-0595-488d-b329-78859f6b30bc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:27.018771 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-b1baff03-6315-4a12-b6e5-4953a00f147b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:27.032950 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-b1baff03-6315-4a12-b6e5-4953a00f147b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1321 microversion: 2.1 time: 1.577554 Oct 03 14:52:27.038511 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 27/52] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:25 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1321 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:27.054140 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-dbb25dc9-4b38-45a9-b654-f612eb898427 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:27.066953 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-dbb25dc9-4b38-45a9-b654-f612eb898427 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:27.084380 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dbb25dc9-4b38-45a9-b654-f612eb898427 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:27.085157 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dbb25dc9-4b38-45a9-b654-f612eb898427 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:27.086031 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dbb25dc9-4b38-45a9-b654-f612eb898427 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:27.095153 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dbb25dc9-4b38-45a9-b654-f612eb898427 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:27.095889 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dbb25dc9-4b38-45a9-b654-f612eb898427 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:27.096545 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dbb25dc9-4b38-45a9-b654-f612eb898427 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:27.304907 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-dbb25dc9-4b38-45a9-b654-f612eb898427 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:27.319638 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-dbb25dc9-4b38-45a9-b654-f612eb898427 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:27.331772 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-dbb25dc9-4b38-45a9-b654-f612eb898427 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:27.334471 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-dbb25dc9-4b38-45a9-b654-f612eb898427 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1333 microversion: 2.20 time: 0.294736 Oct 03 14:52:27.338192 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 28/53] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:27 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1333 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:52:27.345851 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-8b737062-49ee-4ede-9f5d-2963c4fdd71f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:27.350332 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-8b737062-49ee-4ede-9f5d-2963c4fdd71f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:27.358372 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:27.364656 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8b737062-49ee-4ede-9f5d-2963c4fdd71f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:27.365466 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8b737062-49ee-4ede-9f5d-2963c4fdd71f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:27.366176 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8b737062-49ee-4ede-9f5d-2963c4fdd71f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:27.370408 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8b737062-49ee-4ede-9f5d-2963c4fdd71f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:27.371161 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8b737062-49ee-4ede-9f5d-2963c4fdd71f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:27.372232 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8b737062-49ee-4ede-9f5d-2963c4fdd71f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:27.576140 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-8b737062-49ee-4ede-9f5d-2963c4fdd71f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:27.584965 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-8b737062-49ee-4ede-9f5d-2963c4fdd71f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1229 microversion: 2.1 time: 0.244143 Oct 03 14:52:27.608676 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 29/54] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:27 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1229 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:27.751695 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-122c39a1-0595-488d-b329-78859f6b30bc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:27.761192 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-122c39a1-0595-488d-b329-78859f6b30bc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 200 len: 1368 microversion: 2.1 time: 1.338729 Oct 03 14:52:27.765456 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 26/55] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:26 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 1368 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:28.281918 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-2d302a78-c20c-4342-a6b8-669480d84c22 req-1b5ed5df-5128-4cdf-b015-ffb7712524f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e89e5bd3-ef0d-4314-b688-10af4dbf02a8", "tag": "9bdcc1e0-93a1-4a48-839a-e6c7d4339e25"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:28.306184 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-bd573fdf-8be1-4254-ae98-627292a99842 req-a4f96882-7fa8-4ab5-ad3c-da477131a47a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b", "tag": "2e72d55c-b330-49d5-9e42-f12cbb9f7a3b"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:28.310031 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-2d302a78-c20c-4342-a6b8-669480d84c22 req-1b5ed5df-5128-4cdf-b015-ffb7712524f0 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:28.310519 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-2d302a78-c20c-4342-a6b8-669480d84c22 req-1b5ed5df-5128-4cdf-b015-ffb7712524f0 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:28.310956 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-2d302a78-c20c-4342-a6b8-669480d84c22 req-1b5ed5df-5128-4cdf-b015-ffb7712524f0 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:28.325232 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-bd573fdf-8be1-4254-ae98-627292a99842 req-a4f96882-7fa8-4ab5-ad3c-da477131a47a service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:28.326086 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-bd573fdf-8be1-4254-ae98-627292a99842 req-a4f96882-7fa8-4ab5-ad3c-da477131a47a service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:28.326727 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-bd573fdf-8be1-4254-ae98-627292a99842 req-a4f96882-7fa8-4ab5-ad3c-da477131a47a service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:28.356523 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-bd573fdf-8be1-4254-ae98-627292a99842 req-a4f96882-7fa8-4ab5-ad3c-da477131a47a service nova] Creating event network-changed:2e72d55c-b330-49d5-9e42-f12cbb9f7a3b for instance 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b on hv-cinder-85987 Oct 03 14:52:28.357523 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-bd573fdf-8be1-4254-ae98-627292a99842 req-a4f96882-7fa8-4ab5-ad3c-da477131a47a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=126852) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 03 14:52:28.358147 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-bd573fdf-8be1-4254-ae98-627292a99842 req-a4f96882-7fa8-4ab5-ad3c-da477131a47a service nova] Acquired lock "compute-rpcapi-router" {{(pid=126852) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 03 14:52:28.359624 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-101633b0-6fe6-48cf-bce9-b54b475670b2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:28.360321 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-101633b0-6fe6-48cf-bce9-b54b475670b2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:28.360951 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-101633b0-6fe6-48cf-bce9-b54b475670b2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:28.361982 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-101633b0-6fe6-48cf-bce9-b54b475670b2 None None] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:28.362698 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-101633b0-6fe6-48cf-bce9-b54b475670b2 None None] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:28.363417 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-101633b0-6fe6-48cf-bce9-b54b475670b2 None None] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:28.387570 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-2d302a78-c20c-4342-a6b8-669480d84c22 req-1b5ed5df-5128-4cdf-b015-ffb7712524f0 service nova] Creating event network-changed:9bdcc1e0-93a1-4a48-839a-e6c7d4339e25 for instance e89e5bd3-ef0d-4314-b688-10af4dbf02a8 on hv-cinder-85987 Oct 03 14:52:28.388113 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-2d302a78-c20c-4342-a6b8-669480d84c22 req-1b5ed5df-5128-4cdf-b015-ffb7712524f0 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=126851) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 03 14:52:28.388505 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-2d302a78-c20c-4342-a6b8-669480d84c22 req-1b5ed5df-5128-4cdf-b015-ffb7712524f0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=126851) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 03 14:52:28.389639 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6c7e1023-934f-404f-9a42-84228d138fe6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:28.390085 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6c7e1023-934f-404f-9a42-84228d138fe6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:28.390519 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6c7e1023-934f-404f-9a42-84228d138fe6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:28.391251 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6c7e1023-934f-404f-9a42-84228d138fe6 None None] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:28.391699 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6c7e1023-934f-404f-9a42-84228d138fe6 None None] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:28.392121 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6c7e1023-934f-404f-9a42-84228d138fe6 None None] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:28.393575 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.compute.rpcapi [None req-101633b0-6fe6-48cf-bce9-b54b475670b2 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 03 14:52:28.407272 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-101633b0-6fe6-48cf-bce9-b54b475670b2 None None] Releasing lock "compute-rpcapi-router" {{(pid=126852) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 03 14:52:28.437339 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-101633b0-6fe6-48cf-bce9-b54b475670b2 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.669052 Oct 03 14:52:28.438335 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 27/56] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:52:28.438619 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.compute.rpcapi [None req-6c7e1023-934f-404f-9a42-84228d138fe6 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 03 14:52:28.439554 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6c7e1023-934f-404f-9a42-84228d138fe6 None None] Releasing lock "compute-rpcapi-router" {{(pid=126851) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 03 14:52:28.450773 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-8df30d78-443c-4495-924a-976bbef5f967 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:28.453004 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-8df30d78-443c-4495-924a-976bbef5f967 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:28.468114 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-6c7e1023-934f-404f-9a42-84228d138fe6 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.864380 Oct 03 14:52:28.469236 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 30/57] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:52:28.474824 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-60f42896-7eef-4c98-a4c8-d89d6b763fed tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:28.476102 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8df30d78-443c-4495-924a-976bbef5f967 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:28.477010 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-60f42896-7eef-4c98-a4c8-d89d6b763fed tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:28.477950 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8df30d78-443c-4495-924a-976bbef5f967 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:28.480213 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8df30d78-443c-4495-924a-976bbef5f967 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:28.482482 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8df30d78-443c-4495-924a-976bbef5f967 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:28.485670 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8df30d78-443c-4495-924a-976bbef5f967 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:28.486415 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8df30d78-443c-4495-924a-976bbef5f967 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:28.497491 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-60f42896-7eef-4c98-a4c8-d89d6b763fed tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:28.498026 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-60f42896-7eef-4c98-a4c8-d89d6b763fed tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:28.498491 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-60f42896-7eef-4c98-a4c8-d89d6b763fed tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:28.499253 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-60f42896-7eef-4c98-a4c8-d89d6b763fed tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:28.499714 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-60f42896-7eef-4c98-a4c8-d89d6b763fed tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:28.500146 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-60f42896-7eef-4c98-a4c8-d89d6b763fed tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:29.072264 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-60f42896-7eef-4c98-a4c8-d89d6b763fed tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:29.080520 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-60f42896-7eef-4c98-a4c8-d89d6b763fed tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1321 microversion: 2.1 time: 0.609917 Oct 03 14:52:29.093972 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 31/58] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:28 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1321 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:29.093972 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-058360b3-b49d-4518-96aa-5d0134e18b93 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:29.093972 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-058360b3-b49d-4518-96aa-5d0134e18b93 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:29.133047 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-058360b3-b49d-4518-96aa-5d0134e18b93 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:29.133610 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-058360b3-b49d-4518-96aa-5d0134e18b93 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:29.134222 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-058360b3-b49d-4518-96aa-5d0134e18b93 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:29.135140 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-058360b3-b49d-4518-96aa-5d0134e18b93 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:29.137599 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-058360b3-b49d-4518-96aa-5d0134e18b93 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:29.138098 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-058360b3-b49d-4518-96aa-5d0134e18b93 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:29.185709 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=100 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:29.263080 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-8df30d78-443c-4495-924a-976bbef5f967 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:29.270162 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-8df30d78-443c-4495-924a-976bbef5f967 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1314 microversion: 2.1 time: 0.830110 Oct 03 14:52:29.282854 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 28/59] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:28 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1314 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:29.299542 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-7650755c-8905-48d0-85c9-21a2eb8437c5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:29.300785 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-7650755c-8905-48d0-85c9-21a2eb8437c5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:29.301364 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-058360b3-b49d-4518-96aa-5d0134e18b93 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:29.310580 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7650755c-8905-48d0-85c9-21a2eb8437c5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:29.311131 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7650755c-8905-48d0-85c9-21a2eb8437c5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:29.312189 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7650755c-8905-48d0-85c9-21a2eb8437c5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:29.313864 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7650755c-8905-48d0-85c9-21a2eb8437c5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:29.314485 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-058360b3-b49d-4518-96aa-5d0134e18b93 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:29.315112 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7650755c-8905-48d0-85c9-21a2eb8437c5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:29.315218 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7650755c-8905-48d0-85c9-21a2eb8437c5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:29.317989 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-058360b3-b49d-4518-96aa-5d0134e18b93 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:29.321058 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-058360b3-b49d-4518-96aa-5d0134e18b93 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1339 microversion: 2.20 time: 0.238038 Oct 03 14:52:29.321640 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 32/60] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:29 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1339 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:52:29.335584 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-ece50efa-961f-4872-82fc-0a63c25751fe tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:29.338075 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-ece50efa-961f-4872-82fc-0a63c25751fe tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:29.357370 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ece50efa-961f-4872-82fc-0a63c25751fe tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:29.359548 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ece50efa-961f-4872-82fc-0a63c25751fe tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:29.360022 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ece50efa-961f-4872-82fc-0a63c25751fe tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:29.360867 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ece50efa-961f-4872-82fc-0a63c25751fe tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:29.361251 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ece50efa-961f-4872-82fc-0a63c25751fe tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:29.361714 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ece50efa-961f-4872-82fc-0a63c25751fe tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:29.460958 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-7650755c-8905-48d0-85c9-21a2eb8437c5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:29.470538 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-7650755c-8905-48d0-85c9-21a2eb8437c5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1285 microversion: 2.1 time: 0.180653 Oct 03 14:52:29.472613 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 29/61] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:29 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1285 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:29.556696 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-ece50efa-961f-4872-82fc-0a63c25751fe tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:29.565452 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-ece50efa-961f-4872-82fc-0a63c25751fe tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 200 len: 1368 microversion: 2.1 time: 0.237302 Oct 03 14:52:29.566848 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 33/62] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:29 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 1368 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:30.112019 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-f8e3860a-21df-4998-b3d1-4a1c78b95476 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:30.113141 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-f8e3860a-21df-4998-b3d1-4a1c78b95476 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:30.119250 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f8e3860a-21df-4998-b3d1-4a1c78b95476 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:30.119752 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f8e3860a-21df-4998-b3d1-4a1c78b95476 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:30.120184 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f8e3860a-21df-4998-b3d1-4a1c78b95476 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:30.121071 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f8e3860a-21df-4998-b3d1-4a1c78b95476 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:30.121704 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f8e3860a-21df-4998-b3d1-4a1c78b95476 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:30.122284 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f8e3860a-21df-4998-b3d1-4a1c78b95476 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:30.269237 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-f8e3860a-21df-4998-b3d1-4a1c78b95476 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:30.277363 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-f8e3860a-21df-4998-b3d1-4a1c78b95476 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1321 microversion: 2.1 time: 0.169720 Oct 03 14:52:30.278587 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 30/63] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:30 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:30.296864 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-aa618022-265f-410e-8348-5c64d798ec8d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:30.297597 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-aa618022-265f-410e-8348-5c64d798ec8d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:30.304548 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-aa618022-265f-410e-8348-5c64d798ec8d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:30.305116 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-aa618022-265f-410e-8348-5c64d798ec8d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:30.305455 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-aa618022-265f-410e-8348-5c64d798ec8d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:30.306339 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-aa618022-265f-410e-8348-5c64d798ec8d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:30.306789 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-aa618022-265f-410e-8348-5c64d798ec8d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:30.307536 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-aa618022-265f-410e-8348-5c64d798ec8d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:30.349850 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-839c083b-68c8-4809-aa9d-631426755f5f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:30.350453 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-839c083b-68c8-4809-aa9d-631426755f5f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:30.356606 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-839c083b-68c8-4809-aa9d-631426755f5f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:30.357032 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-839c083b-68c8-4809-aa9d-631426755f5f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:30.357468 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-839c083b-68c8-4809-aa9d-631426755f5f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:30.358197 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-839c083b-68c8-4809-aa9d-631426755f5f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:30.358649 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-839c083b-68c8-4809-aa9d-631426755f5f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:30.359064 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-839c083b-68c8-4809-aa9d-631426755f5f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:30.438099 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-839c083b-68c8-4809-aa9d-631426755f5f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:30.450160 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-839c083b-68c8-4809-aa9d-631426755f5f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:30.452900 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-839c083b-68c8-4809-aa9d-631426755f5f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:30.455533 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-839c083b-68c8-4809-aa9d-631426755f5f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1339 microversion: 2.20 time: 0.108877 Oct 03 14:52:30.456953 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 31/64] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:30 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1339 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:52:30.468749 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-aa618022-265f-410e-8348-5c64d798ec8d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:30.481532 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-aa618022-265f-410e-8348-5c64d798ec8d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1314 microversion: 2.1 time: 0.189030 Oct 03 14:52:30.482405 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 34/65] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:30 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:30.500503 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-cec961e7-afe8-4735-bee2-8873081961c0 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:30.501953 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-cec961e7-afe8-4735-bee2-8873081961c0 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:30.512000 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cec961e7-afe8-4735-bee2-8873081961c0 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:30.512498 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cec961e7-afe8-4735-bee2-8873081961c0 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:30.513297 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cec961e7-afe8-4735-bee2-8873081961c0 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:30.514555 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cec961e7-afe8-4735-bee2-8873081961c0 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:30.515247 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cec961e7-afe8-4735-bee2-8873081961c0 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:30.515675 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cec961e7-afe8-4735-bee2-8873081961c0 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:30.547397 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-6451ef54-2cd8-4215-af83-a4dd6fd4bf2e req-587877c9-5f3b-48d9-834c-3b1812f91855 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93eb4038-8732-40ab-b4ff-b9ba16dab3f3", "tag": "d7ceaf30-9e00-432b-b831-684569089003"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:30.558801 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-6451ef54-2cd8-4215-af83-a4dd6fd4bf2e req-587877c9-5f3b-48d9-834c-3b1812f91855 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:30.559753 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-6451ef54-2cd8-4215-af83-a4dd6fd4bf2e req-587877c9-5f3b-48d9-834c-3b1812f91855 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:30.560536 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-6451ef54-2cd8-4215-af83-a4dd6fd4bf2e req-587877c9-5f3b-48d9-834c-3b1812f91855 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:30.573231 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-6451ef54-2cd8-4215-af83-a4dd6fd4bf2e req-587877c9-5f3b-48d9-834c-3b1812f91855 service nova] Creating event network-changed:d7ceaf30-9e00-432b-b831-684569089003 for instance 93eb4038-8732-40ab-b4ff-b9ba16dab3f3 on hv-cinder-85987 Oct 03 14:52:30.579459 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-6451ef54-2cd8-4215-af83-a4dd6fd4bf2e req-587877c9-5f3b-48d9-834c-3b1812f91855 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037051 Oct 03 14:52:30.580787 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 35/66] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:52:30.590545 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-5572e762-9d21-49e7-8eae-716e35ae867f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:30.591588 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-5572e762-9d21-49e7-8eae-716e35ae867f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:30.594605 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-cec961e7-afe8-4735-bee2-8873081961c0 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:30.598708 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5572e762-9d21-49e7-8eae-716e35ae867f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:30.599193 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5572e762-9d21-49e7-8eae-716e35ae867f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:30.599794 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5572e762-9d21-49e7-8eae-716e35ae867f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:30.600812 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5572e762-9d21-49e7-8eae-716e35ae867f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:30.601388 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5572e762-9d21-49e7-8eae-716e35ae867f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:30.601957 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5572e762-9d21-49e7-8eae-716e35ae867f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:30.604568 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-cec961e7-afe8-4735-bee2-8873081961c0 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1285 microversion: 2.1 time: 0.109756 Oct 03 14:52:30.605171 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 32/67] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:30 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:30.698212 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-fdc71562-c524-48d8-b313-7e76cd6f4b62 req-f57fce59-90ec-4c8f-98ab-7e10677cb60d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "193f7fe8-5737-49b3-a165-4345f3357042", "tag": "06e443b0-42ce-487b-9e0c-244828a5e40e"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:30.713768 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-fdc71562-c524-48d8-b313-7e76cd6f4b62 req-f57fce59-90ec-4c8f-98ab-7e10677cb60d service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:30.714540 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-fdc71562-c524-48d8-b313-7e76cd6f4b62 req-f57fce59-90ec-4c8f-98ab-7e10677cb60d service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:30.715212 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-fdc71562-c524-48d8-b313-7e76cd6f4b62 req-f57fce59-90ec-4c8f-98ab-7e10677cb60d service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:30.720343 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=100 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:30.734198 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-fdc71562-c524-48d8-b313-7e76cd6f4b62 req-f57fce59-90ec-4c8f-98ab-7e10677cb60d service nova] Creating event network-changed:06e443b0-42ce-487b-9e0c-244828a5e40e for instance 193f7fe8-5737-49b3-a165-4345f3357042 on hv-cinder-85987 Oct 03 14:52:30.739539 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-fdc71562-c524-48d8-b313-7e76cd6f4b62 req-f57fce59-90ec-4c8f-98ab-7e10677cb60d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051634 Oct 03 14:52:30.740641 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 33/68] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:52:30.770536 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-5572e762-9d21-49e7-8eae-716e35ae867f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:30.783868 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-5572e762-9d21-49e7-8eae-716e35ae867f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 200 len: 1368 microversion: 2.1 time: 0.199103 Oct 03 14:52:30.785932 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 36/69] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:30 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 1368 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:31.309126 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-2c5fe560-762c-4a28-9ae3-1c401d58f5e1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:31.309862 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-2c5fe560-762c-4a28-9ae3-1c401d58f5e1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:31.316172 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2c5fe560-762c-4a28-9ae3-1c401d58f5e1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:31.316813 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2c5fe560-762c-4a28-9ae3-1c401d58f5e1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:31.317431 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2c5fe560-762c-4a28-9ae3-1c401d58f5e1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:31.318159 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2c5fe560-762c-4a28-9ae3-1c401d58f5e1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:31.318945 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2c5fe560-762c-4a28-9ae3-1c401d58f5e1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:31.319586 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2c5fe560-762c-4a28-9ae3-1c401d58f5e1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:31.464214 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-2c5fe560-762c-4a28-9ae3-1c401d58f5e1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:31.474044 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-2c5fe560-762c-4a28-9ae3-1c401d58f5e1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1321 microversion: 2.1 time: 0.169303 Oct 03 14:52:31.485838 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 34/70] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:31 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:31.486030 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-3956a170-28ff-429e-bddf-7f566901835b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:31.486030 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-3956a170-28ff-429e-bddf-7f566901835b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:31.489339 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3956a170-28ff-429e-bddf-7f566901835b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:31.489857 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3956a170-28ff-429e-bddf-7f566901835b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:31.490290 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3956a170-28ff-429e-bddf-7f566901835b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:31.490988 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3956a170-28ff-429e-bddf-7f566901835b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:31.491573 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3956a170-28ff-429e-bddf-7f566901835b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:31.491994 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3956a170-28ff-429e-bddf-7f566901835b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:31.506829 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-5fd5cf9d-f493-4def-8db6-71f9349b2ce7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:31.507543 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-5fd5cf9d-f493-4def-8db6-71f9349b2ce7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:31.516754 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5fd5cf9d-f493-4def-8db6-71f9349b2ce7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:31.517388 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5fd5cf9d-f493-4def-8db6-71f9349b2ce7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:31.518048 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5fd5cf9d-f493-4def-8db6-71f9349b2ce7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:31.528327 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5fd5cf9d-f493-4def-8db6-71f9349b2ce7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:31.529582 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5fd5cf9d-f493-4def-8db6-71f9349b2ce7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:31.530422 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5fd5cf9d-f493-4def-8db6-71f9349b2ce7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:31.562322 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-3956a170-28ff-429e-bddf-7f566901835b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:31.571447 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-3956a170-28ff-429e-bddf-7f566901835b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:31.573219 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-3956a170-28ff-429e-bddf-7f566901835b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:31.574728 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-3956a170-28ff-429e-bddf-7f566901835b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1339 microversion: 2.20 time: 0.096078 Oct 03 14:52:31.575389 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 37/71] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:31 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1339 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:52:31.628203 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-29e111aa-5d4d-40c5-8f0f-7ca8a448a21a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:31.629066 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-29e111aa-5d4d-40c5-8f0f-7ca8a448a21a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:31.635309 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-29e111aa-5d4d-40c5-8f0f-7ca8a448a21a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:31.636100 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-29e111aa-5d4d-40c5-8f0f-7ca8a448a21a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:31.636630 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-29e111aa-5d4d-40c5-8f0f-7ca8a448a21a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:31.637726 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-29e111aa-5d4d-40c5-8f0f-7ca8a448a21a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:31.638456 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-29e111aa-5d4d-40c5-8f0f-7ca8a448a21a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:31.639026 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-29e111aa-5d4d-40c5-8f0f-7ca8a448a21a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:31.711943 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-29e111aa-5d4d-40c5-8f0f-7ca8a448a21a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:31.716430 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-5fd5cf9d-f493-4def-8db6-71f9349b2ce7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:31.722695 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-29e111aa-5d4d-40c5-8f0f-7ca8a448a21a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1285 microversion: 2.1 time: 0.098190 Oct 03 14:52:31.723906 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 38/72] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:31 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:31.725457 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-5fd5cf9d-f493-4def-8db6-71f9349b2ce7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1314 microversion: 2.1 time: 0.222577 Oct 03 14:52:31.726055 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 35/73] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:31 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:31.806810 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-a412a0e4-3cfa-488d-99d9-2239a85165a8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:31.807422 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-a412a0e4-3cfa-488d-99d9-2239a85165a8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:31.813610 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a412a0e4-3cfa-488d-99d9-2239a85165a8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:31.814095 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a412a0e4-3cfa-488d-99d9-2239a85165a8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:31.814730 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a412a0e4-3cfa-488d-99d9-2239a85165a8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:31.815428 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a412a0e4-3cfa-488d-99d9-2239a85165a8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:31.816483 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a412a0e4-3cfa-488d-99d9-2239a85165a8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:31.816911 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a412a0e4-3cfa-488d-99d9-2239a85165a8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:31.963097 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-a412a0e4-3cfa-488d-99d9-2239a85165a8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:31.973769 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-a412a0e4-3cfa-488d-99d9-2239a85165a8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 200 len: 1368 microversion: 2.1 time: 0.168531 Oct 03 14:52:31.974378 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 39/74] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:31 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:32.500986 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-df7ab12f-4119-4b0e-b0e4-a901a0bb834a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:32.501632 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-df7ab12f-4119-4b0e-b0e4-a901a0bb834a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:32.507492 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-df7ab12f-4119-4b0e-b0e4-a901a0bb834a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:32.507978 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-df7ab12f-4119-4b0e-b0e4-a901a0bb834a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:32.508412 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-df7ab12f-4119-4b0e-b0e4-a901a0bb834a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:32.509105 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-df7ab12f-4119-4b0e-b0e4-a901a0bb834a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:32.509591 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-df7ab12f-4119-4b0e-b0e4-a901a0bb834a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:32.510020 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-df7ab12f-4119-4b0e-b0e4-a901a0bb834a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:32.608004 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-fd62d7c4-6cc1-468a-96f4-8e1949bb4a0e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:32.608651 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-fd62d7c4-6cc1-468a-96f4-8e1949bb4a0e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:32.614477 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fd62d7c4-6cc1-468a-96f4-8e1949bb4a0e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:32.615134 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fd62d7c4-6cc1-468a-96f4-8e1949bb4a0e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:32.615709 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fd62d7c4-6cc1-468a-96f4-8e1949bb4a0e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:32.616539 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fd62d7c4-6cc1-468a-96f4-8e1949bb4a0e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:32.617153 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fd62d7c4-6cc1-468a-96f4-8e1949bb4a0e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:32.617751 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fd62d7c4-6cc1-468a-96f4-8e1949bb4a0e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:32.645885 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-df7ab12f-4119-4b0e-b0e4-a901a0bb834a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:32.654112 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-df7ab12f-4119-4b0e-b0e4-a901a0bb834a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1321 microversion: 2.1 time: 0.156862 Oct 03 14:52:32.654681 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 36/75] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:32 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:32.684194 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-fd62d7c4-6cc1-468a-96f4-8e1949bb4a0e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:32.692590 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-fd62d7c4-6cc1-468a-96f4-8e1949bb4a0e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:32.694086 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-fd62d7c4-6cc1-468a-96f4-8e1949bb4a0e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:32.695231 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-fd62d7c4-6cc1-468a-96f4-8e1949bb4a0e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1339 microversion: 2.20 time: 0.091022 Oct 03 14:52:32.695787 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 40/76] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:32 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1339 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:52:32.746213 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-5b3ab2b4-073f-4079-a7a4-da5521c210cd tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:32.746931 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-5b3ab2b4-073f-4079-a7a4-da5521c210cd tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:32.751461 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-d6078962-5ec8-463e-b35d-c8f3c11fda82 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:32.752146 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-d6078962-5ec8-463e-b35d-c8f3c11fda82 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:32.753573 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5b3ab2b4-073f-4079-a7a4-da5521c210cd tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:32.754066 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5b3ab2b4-073f-4079-a7a4-da5521c210cd tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:32.754495 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5b3ab2b4-073f-4079-a7a4-da5521c210cd tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:32.755180 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5b3ab2b4-073f-4079-a7a4-da5521c210cd tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:32.755636 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5b3ab2b4-073f-4079-a7a4-da5521c210cd tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:32.756055 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5b3ab2b4-073f-4079-a7a4-da5521c210cd tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:32.759954 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d6078962-5ec8-463e-b35d-c8f3c11fda82 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:32.761526 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d6078962-5ec8-463e-b35d-c8f3c11fda82 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:32.761526 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d6078962-5ec8-463e-b35d-c8f3c11fda82 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:32.761725 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d6078962-5ec8-463e-b35d-c8f3c11fda82 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:32.762270 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d6078962-5ec8-463e-b35d-c8f3c11fda82 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:32.762706 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d6078962-5ec8-463e-b35d-c8f3c11fda82 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:32.825259 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-5b3ab2b4-073f-4079-a7a4-da5521c210cd tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:32.833443 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-5b3ab2b4-073f-4079-a7a4-da5521c210cd tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1285 microversion: 2.1 time: 0.091056 Oct 03 14:52:32.834039 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 37/77] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:32 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:32.924399 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-d6078962-5ec8-463e-b35d-c8f3c11fda82 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:32.932052 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-d6078962-5ec8-463e-b35d-c8f3c11fda82 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1314 microversion: 2.1 time: 0.186367 Oct 03 14:52:32.932692 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 41/78] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:32 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:32.996690 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-5f10b56e-dfe6-419a-ad9e-6436514843f4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:32.997342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-5f10b56e-dfe6-419a-ad9e-6436514843f4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:33.003636 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5f10b56e-dfe6-419a-ad9e-6436514843f4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:33.004119 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5f10b56e-dfe6-419a-ad9e-6436514843f4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:33.004552 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5f10b56e-dfe6-419a-ad9e-6436514843f4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:33.005244 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5f10b56e-dfe6-419a-ad9e-6436514843f4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:33.005726 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5f10b56e-dfe6-419a-ad9e-6436514843f4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:33.006146 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5f10b56e-dfe6-419a-ad9e-6436514843f4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:33.138451 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-5f10b56e-dfe6-419a-ad9e-6436514843f4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:33.146728 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-5f10b56e-dfe6-419a-ad9e-6436514843f4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 200 len: 1368 microversion: 2.1 time: 0.153943 Oct 03 14:52:33.147639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 38/79] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:32 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:33.677076 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-e3136c14-1b8e-4cc4-bebd-bf3c6287a3c8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:33.677778 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-e3136c14-1b8e-4cc4-bebd-bf3c6287a3c8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:33.683862 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e3136c14-1b8e-4cc4-bebd-bf3c6287a3c8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:33.684357 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e3136c14-1b8e-4cc4-bebd-bf3c6287a3c8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:33.684791 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e3136c14-1b8e-4cc4-bebd-bf3c6287a3c8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:33.685511 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e3136c14-1b8e-4cc4-bebd-bf3c6287a3c8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:33.685971 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e3136c14-1b8e-4cc4-bebd-bf3c6287a3c8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:33.686389 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e3136c14-1b8e-4cc4-bebd-bf3c6287a3c8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:33.722499 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-7a2e25c3-f6f3-4ad2-8214-a9c851a71276 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:33.723143 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-7a2e25c3-f6f3-4ad2-8214-a9c851a71276 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:33.730822 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7a2e25c3-f6f3-4ad2-8214-a9c851a71276 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:33.731497 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7a2e25c3-f6f3-4ad2-8214-a9c851a71276 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:33.731934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7a2e25c3-f6f3-4ad2-8214-a9c851a71276 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:33.733270 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7a2e25c3-f6f3-4ad2-8214-a9c851a71276 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:33.735333 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7a2e25c3-f6f3-4ad2-8214-a9c851a71276 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:33.736081 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7a2e25c3-f6f3-4ad2-8214-a9c851a71276 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:33.817532 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-7a2e25c3-f6f3-4ad2-8214-a9c851a71276 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:33.826948 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-7a2e25c3-f6f3-4ad2-8214-a9c851a71276 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:33.828727 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-7a2e25c3-f6f3-4ad2-8214-a9c851a71276 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:33.830221 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-7a2e25c3-f6f3-4ad2-8214-a9c851a71276 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1339 microversion: 2.20 time: 0.113902 Oct 03 14:52:33.830776 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 39/80] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:33 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1339 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:52:33.831282 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-e3136c14-1b8e-4cc4-bebd-bf3c6287a3c8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:33.839211 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-e3136c14-1b8e-4cc4-bebd-bf3c6287a3c8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1321 microversion: 2.1 time: 0.166480 Oct 03 14:52:33.845791 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 42/81] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:33 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:33.856157 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-edc665d6-1dac-4391-a249-20f7c1ca5b8f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:33.856766 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-edc665d6-1dac-4391-a249-20f7c1ca5b8f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:33.863573 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-edc665d6-1dac-4391-a249-20f7c1ca5b8f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:33.863927 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-edc665d6-1dac-4391-a249-20f7c1ca5b8f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:33.864485 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-edc665d6-1dac-4391-a249-20f7c1ca5b8f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:33.865033 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-edc665d6-1dac-4391-a249-20f7c1ca5b8f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:33.865487 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-edc665d6-1dac-4391-a249-20f7c1ca5b8f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:33.865930 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-edc665d6-1dac-4391-a249-20f7c1ca5b8f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:33.930422 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-edc665d6-1dac-4391-a249-20f7c1ca5b8f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:33.938250 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-edc665d6-1dac-4391-a249-20f7c1ca5b8f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1285 microversion: 2.1 time: 0.085749 Oct 03 14:52:33.938820 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 40/82] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:33 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:33.954771 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-83a28ed1-7e7f-4cf7-b994-19bd8ade10df tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:33.955454 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-83a28ed1-7e7f-4cf7-b994-19bd8ade10df tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:33.961911 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-83a28ed1-7e7f-4cf7-b994-19bd8ade10df tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:33.962396 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-83a28ed1-7e7f-4cf7-b994-19bd8ade10df tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:33.962830 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-83a28ed1-7e7f-4cf7-b994-19bd8ade10df tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:33.963528 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-83a28ed1-7e7f-4cf7-b994-19bd8ade10df tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:33.963984 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-83a28ed1-7e7f-4cf7-b994-19bd8ade10df tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:33.964408 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-83a28ed1-7e7f-4cf7-b994-19bd8ade10df tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:34.095483 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-83a28ed1-7e7f-4cf7-b994-19bd8ade10df tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:34.106107 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-83a28ed1-7e7f-4cf7-b994-19bd8ade10df tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1314 microversion: 2.1 time: 0.155260 Oct 03 14:52:34.106711 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 43/83] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:33 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:34.168575 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-8ab81805-397b-49f9-8796-3c5b21bd8d52 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:34.169194 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-8ab81805-397b-49f9-8796-3c5b21bd8d52 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:34.175760 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8ab81805-397b-49f9-8796-3c5b21bd8d52 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:34.176256 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8ab81805-397b-49f9-8796-3c5b21bd8d52 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:34.176699 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8ab81805-397b-49f9-8796-3c5b21bd8d52 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:34.177389 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8ab81805-397b-49f9-8796-3c5b21bd8d52 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:34.177877 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8ab81805-397b-49f9-8796-3c5b21bd8d52 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:34.178304 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8ab81805-397b-49f9-8796-3c5b21bd8d52 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:34.462824 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-8ab81805-397b-49f9-8796-3c5b21bd8d52 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:34.471454 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-8ab81805-397b-49f9-8796-3c5b21bd8d52 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 200 len: 1368 microversion: 2.1 time: 0.306765 Oct 03 14:52:34.472083 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 41/84] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:34 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 1368 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:34.854960 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-3d6a534e-6911-4dfb-bc70-f678e401799c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:34.855654 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-3d6a534e-6911-4dfb-bc70-f678e401799c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:34.861585 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3d6a534e-6911-4dfb-bc70-f678e401799c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:34.862745 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3d6a534e-6911-4dfb-bc70-f678e401799c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:34.863498 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3d6a534e-6911-4dfb-bc70-f678e401799c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:34.864373 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-aa17c174-b6fc-427d-aaa5-af77ef6f79e1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:34.864792 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3d6a534e-6911-4dfb-bc70-f678e401799c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:34.865234 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-aa17c174-b6fc-427d-aaa5-af77ef6f79e1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:34.865807 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3d6a534e-6911-4dfb-bc70-f678e401799c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:34.865931 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3d6a534e-6911-4dfb-bc70-f678e401799c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:34.871570 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-aa17c174-b6fc-427d-aaa5-af77ef6f79e1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:34.872173 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-aa17c174-b6fc-427d-aaa5-af77ef6f79e1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:34.872768 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-aa17c174-b6fc-427d-aaa5-af77ef6f79e1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:34.873894 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-aa17c174-b6fc-427d-aaa5-af77ef6f79e1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:34.874475 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-aa17c174-b6fc-427d-aaa5-af77ef6f79e1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:34.875170 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-aa17c174-b6fc-427d-aaa5-af77ef6f79e1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:34.964717 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-3d6a534e-6911-4dfb-bc70-f678e401799c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:34.978978 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-3d6a534e-6911-4dfb-bc70-f678e401799c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:34.980845 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-3d6a534e-6911-4dfb-bc70-f678e401799c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:34.982238 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-3d6a534e-6911-4dfb-bc70-f678e401799c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1339 microversion: 2.20 time: 0.131351 Oct 03 14:52:34.983097 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 44/85] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:34 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1339 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:52:34.988693 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-5f288c4a-2048-489b-9679-bdb026556c93 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:34.989801 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-5f288c4a-2048-489b-9679-bdb026556c93 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:34.996509 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5f288c4a-2048-489b-9679-bdb026556c93 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:35.000149 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5f288c4a-2048-489b-9679-bdb026556c93 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:35.000149 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5f288c4a-2048-489b-9679-bdb026556c93 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:35.000149 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5f288c4a-2048-489b-9679-bdb026556c93 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:35.000149 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5f288c4a-2048-489b-9679-bdb026556c93 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:35.001448 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5f288c4a-2048-489b-9679-bdb026556c93 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:35.068216 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-5f288c4a-2048-489b-9679-bdb026556c93 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:35.076221 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-5f288c4a-2048-489b-9679-bdb026556c93 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1293 microversion: 2.1 time: 0.091892 Oct 03 14:52:35.076880 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 45/86] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:34 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:35.129076 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-4d6930d4-2479-42ce-be9e-d0cdd58d0bc0 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:35.129723 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-4d6930d4-2479-42ce-be9e-d0cdd58d0bc0 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:35.135689 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4d6930d4-2479-42ce-be9e-d0cdd58d0bc0 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:35.137144 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4d6930d4-2479-42ce-be9e-d0cdd58d0bc0 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:35.137648 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4d6930d4-2479-42ce-be9e-d0cdd58d0bc0 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:35.138353 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4d6930d4-2479-42ce-be9e-d0cdd58d0bc0 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:35.138811 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4d6930d4-2479-42ce-be9e-d0cdd58d0bc0 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:35.139235 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4d6930d4-2479-42ce-be9e-d0cdd58d0bc0 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:35.258104 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell0:SELECT=6 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:35.273114 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-4d6930d4-2479-42ce-be9e-d0cdd58d0bc0 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:35.279351 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell0:SELECT=6 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:35.283260 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-4d6930d4-2479-42ce-be9e-d0cdd58d0bc0 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1314 microversion: 2.1 time: 0.158159 Oct 03 14:52:35.283831 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 46/87] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:35 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:35.417032 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-aa17c174-b6fc-427d-aaa5-af77ef6f79e1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:35.425225 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-aa17c174-b6fc-427d-aaa5-af77ef6f79e1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1321 microversion: 2.1 time: 0.565730 Oct 03 14:52:35.425840 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 42/88] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:34 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1321 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:35.494453 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-4f25f484-e9eb-48c3-af78-94521afbce4a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:35.495078 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-4f25f484-e9eb-48c3-af78-94521afbce4a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:35.502969 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4f25f484-e9eb-48c3-af78-94521afbce4a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:35.503621 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4f25f484-e9eb-48c3-af78-94521afbce4a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:35.504229 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4f25f484-e9eb-48c3-af78-94521afbce4a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:35.505058 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4f25f484-e9eb-48c3-af78-94521afbce4a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:35.505689 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4f25f484-e9eb-48c3-af78-94521afbce4a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:35.506244 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4f25f484-e9eb-48c3-af78-94521afbce4a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:35.695308 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-4f25f484-e9eb-48c3-af78-94521afbce4a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:35.703865 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-4f25f484-e9eb-48c3-af78-94521afbce4a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 200 len: 1368 microversion: 2.1 time: 0.213140 Oct 03 14:52:35.707489 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 47/89] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:35 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 1368 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:36.013873 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-5ab5c6aa-1822-44a0-965b-2abad240719b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:36.014477 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-5ab5c6aa-1822-44a0-965b-2abad240719b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:36.021809 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5ab5c6aa-1822-44a0-965b-2abad240719b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:36.022500 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5ab5c6aa-1822-44a0-965b-2abad240719b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:36.023109 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5ab5c6aa-1822-44a0-965b-2abad240719b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:36.024416 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5ab5c6aa-1822-44a0-965b-2abad240719b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:36.025151 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5ab5c6aa-1822-44a0-965b-2abad240719b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:36.025812 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5ab5c6aa-1822-44a0-965b-2abad240719b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:36.101454 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-a9806b55-f490-471f-991a-d567b306615c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:36.102171 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-a9806b55-f490-471f-991a-d567b306615c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:36.110160 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a9806b55-f490-471f-991a-d567b306615c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:36.110780 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a9806b55-f490-471f-991a-d567b306615c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:36.111615 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a9806b55-f490-471f-991a-d567b306615c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:36.113097 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a9806b55-f490-471f-991a-d567b306615c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:36.113762 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a9806b55-f490-471f-991a-d567b306615c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:36.114626 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a9806b55-f490-471f-991a-d567b306615c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:36.182377 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-a9806b55-f490-471f-991a-d567b306615c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:36.185687 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-5ab5c6aa-1822-44a0-965b-2abad240719b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:36.194553 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-a9806b55-f490-471f-991a-d567b306615c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1293 microversion: 2.1 time: 0.097888 Oct 03 14:52:36.195350 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 48/90] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:36 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1293 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:36.197045 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-5ab5c6aa-1822-44a0-965b-2abad240719b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:36.198513 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-5ab5c6aa-1822-44a0-965b-2abad240719b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:36.199629 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-5ab5c6aa-1822-44a0-965b-2abad240719b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1407 microversion: 2.20 time: 0.190392 Oct 03 14:52:36.200327 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 43/91] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:36 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:52:36.306838 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-4916219b-cdfa-4f1b-9e3f-3a498b73cd03 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:36.307454 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-4916219b-cdfa-4f1b-9e3f-3a498b73cd03 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:36.313257 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4916219b-cdfa-4f1b-9e3f-3a498b73cd03 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:36.313780 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4916219b-cdfa-4f1b-9e3f-3a498b73cd03 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:36.314212 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4916219b-cdfa-4f1b-9e3f-3a498b73cd03 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:36.314890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4916219b-cdfa-4f1b-9e3f-3a498b73cd03 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:36.316018 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4916219b-cdfa-4f1b-9e3f-3a498b73cd03 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:36.316722 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4916219b-cdfa-4f1b-9e3f-3a498b73cd03 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:36.447754 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-41e814b7-3aac-4b39-a041-17865564dd2c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:36.448366 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-41e814b7-3aac-4b39-a041-17865564dd2c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:36.451297 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-4916219b-cdfa-4f1b-9e3f-3a498b73cd03 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:36.454755 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-41e814b7-3aac-4b39-a041-17865564dd2c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:36.454883 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=100 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:36.455287 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-41e814b7-3aac-4b39-a041-17865564dd2c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:36.455753 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-41e814b7-3aac-4b39-a041-17865564dd2c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:36.456740 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-41e814b7-3aac-4b39-a041-17865564dd2c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:36.457407 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-41e814b7-3aac-4b39-a041-17865564dd2c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:36.457965 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-41e814b7-3aac-4b39-a041-17865564dd2c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:36.460317 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-4916219b-cdfa-4f1b-9e3f-3a498b73cd03 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1314 microversion: 2.1 time: 0.157444 Oct 03 14:52:36.461053 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 49/92] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:36 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:36.621969 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-41e814b7-3aac-4b39-a041-17865564dd2c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:36.630586 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-41e814b7-3aac-4b39-a041-17865564dd2c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1321 microversion: 2.1 time: 0.186598 Oct 03 14:52:36.631766 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 44/93] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:36 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:36.733117 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-dce83727-a186-4baa-8630-d2c532edfdfe tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:36.733747 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-dce83727-a186-4baa-8630-d2c532edfdfe tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:36.740809 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dce83727-a186-4baa-8630-d2c532edfdfe tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:36.741238 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dce83727-a186-4baa-8630-d2c532edfdfe tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:36.741714 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dce83727-a186-4baa-8630-d2c532edfdfe tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:36.742401 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dce83727-a186-4baa-8630-d2c532edfdfe tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:36.743095 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dce83727-a186-4baa-8630-d2c532edfdfe tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:36.743242 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dce83727-a186-4baa-8630-d2c532edfdfe tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:36.881122 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-dce83727-a186-4baa-8630-d2c532edfdfe tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:36.888816 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-dce83727-a186-4baa-8630-d2c532edfdfe tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 200 len: 1368 microversion: 2.1 time: 0.160306 Oct 03 14:52:36.889383 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 50/94] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:36 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:37.216014 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-831d6fa8-6463-4cad-b8c1-8a6f3129841e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:37.216667 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-831d6fa8-6463-4cad-b8c1-8a6f3129841e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:37.223079 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-831d6fa8-6463-4cad-b8c1-8a6f3129841e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:37.223563 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-831d6fa8-6463-4cad-b8c1-8a6f3129841e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:37.224000 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-831d6fa8-6463-4cad-b8c1-8a6f3129841e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:37.224340 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-8e506a40-347a-470b-9594-b1b291eb6d00 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:37.224729 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-831d6fa8-6463-4cad-b8c1-8a6f3129841e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:37.224947 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-8e506a40-347a-470b-9594-b1b291eb6d00 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:37.225131 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-831d6fa8-6463-4cad-b8c1-8a6f3129841e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:37.225594 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-831d6fa8-6463-4cad-b8c1-8a6f3129841e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:37.231006 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8e506a40-347a-470b-9594-b1b291eb6d00 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:37.231482 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8e506a40-347a-470b-9594-b1b291eb6d00 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:37.231909 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8e506a40-347a-470b-9594-b1b291eb6d00 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:37.232592 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8e506a40-347a-470b-9594-b1b291eb6d00 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:37.233062 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8e506a40-347a-470b-9594-b1b291eb6d00 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:37.233478 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8e506a40-347a-470b-9594-b1b291eb6d00 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:37.286875 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-831d6fa8-6463-4cad-b8c1-8a6f3129841e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:37.294776 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-831d6fa8-6463-4cad-b8c1-8a6f3129841e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1303 microversion: 2.1 time: 0.082523 Oct 03 14:52:37.295684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 45/95] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:37 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1303 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:37.363063 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-8e506a40-347a-470b-9594-b1b291eb6d00 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:37.371610 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-8e506a40-347a-470b-9594-b1b291eb6d00 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:37.373031 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-8e506a40-347a-470b-9594-b1b291eb6d00 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:37.374147 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-8e506a40-347a-470b-9594-b1b291eb6d00 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1407 microversion: 2.20 time: 0.153744 Oct 03 14:52:37.374702 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 51/96] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:37 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:52:37.484385 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-7ded0794-c41c-41b6-8190-a87665185f17 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:37.484942 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-7ded0794-c41c-41b6-8190-a87665185f17 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:37.491449 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7ded0794-c41c-41b6-8190-a87665185f17 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:37.491929 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7ded0794-c41c-41b6-8190-a87665185f17 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:37.492365 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7ded0794-c41c-41b6-8190-a87665185f17 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:37.493048 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7ded0794-c41c-41b6-8190-a87665185f17 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:37.493555 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7ded0794-c41c-41b6-8190-a87665185f17 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:37.493945 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7ded0794-c41c-41b6-8190-a87665185f17 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:37.623904 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-7ded0794-c41c-41b6-8190-a87665185f17 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:37.632567 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-7ded0794-c41c-41b6-8190-a87665185f17 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1314 microversion: 2.1 time: 0.152025 Oct 03 14:52:37.633131 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 46/97] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:37 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:37.653421 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-d05b82df-f061-4ea7-b526-81cefcebd329 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:37.654046 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-d05b82df-f061-4ea7-b526-81cefcebd329 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:37.660430 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d05b82df-f061-4ea7-b526-81cefcebd329 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:37.660902 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d05b82df-f061-4ea7-b526-81cefcebd329 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:37.661326 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d05b82df-f061-4ea7-b526-81cefcebd329 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:37.662032 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d05b82df-f061-4ea7-b526-81cefcebd329 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:37.662475 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d05b82df-f061-4ea7-b526-81cefcebd329 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:37.662889 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d05b82df-f061-4ea7-b526-81cefcebd329 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:37.791078 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-d05b82df-f061-4ea7-b526-81cefcebd329 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:37.798598 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-d05b82df-f061-4ea7-b526-81cefcebd329 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1321 microversion: 2.1 time: 0.148938 Oct 03 14:52:37.799159 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 52/98] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:37 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:37.912558 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-ce80cc36-709e-4886-a370-e0af7cc16b05 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:37.913375 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-ce80cc36-709e-4886-a370-e0af7cc16b05 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:37.919336 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ce80cc36-709e-4886-a370-e0af7cc16b05 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:37.919935 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ce80cc36-709e-4886-a370-e0af7cc16b05 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:37.920373 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ce80cc36-709e-4886-a370-e0af7cc16b05 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:37.921066 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ce80cc36-709e-4886-a370-e0af7cc16b05 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:37.921547 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ce80cc36-709e-4886-a370-e0af7cc16b05 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:37.921974 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ce80cc36-709e-4886-a370-e0af7cc16b05 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:38.050122 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-ce80cc36-709e-4886-a370-e0af7cc16b05 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:38.057874 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-ce80cc36-709e-4886-a370-e0af7cc16b05 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 200 len: 1368 microversion: 2.1 time: 0.149685 Oct 03 14:52:38.058438 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 47/99] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:37 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:38.318612 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-138ca6d8-a594-45f2-b072-210a0c04aaa8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:38.319219 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-138ca6d8-a594-45f2-b072-210a0c04aaa8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:38.325065 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-138ca6d8-a594-45f2-b072-210a0c04aaa8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:38.325572 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-138ca6d8-a594-45f2-b072-210a0c04aaa8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:38.326007 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-138ca6d8-a594-45f2-b072-210a0c04aaa8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:38.326678 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-138ca6d8-a594-45f2-b072-210a0c04aaa8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:38.327122 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-138ca6d8-a594-45f2-b072-210a0c04aaa8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:38.327537 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-138ca6d8-a594-45f2-b072-210a0c04aaa8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:38.386796 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-138ca6d8-a594-45f2-b072-210a0c04aaa8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:38.395188 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-138ca6d8-a594-45f2-b072-210a0c04aaa8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1303 microversion: 2.1 time: 0.080781 Oct 03 14:52:38.395890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 53/100] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:38 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1303 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:38.400217 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-c6091b9c-178e-4681-9687-31f7ada08a37 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:38.400911 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-c6091b9c-178e-4681-9687-31f7ada08a37 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:38.402779 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell0:SELECT=4 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:38.408205 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c6091b9c-178e-4681-9687-31f7ada08a37 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:38.408692 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c6091b9c-178e-4681-9687-31f7ada08a37 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:38.409128 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c6091b9c-178e-4681-9687-31f7ada08a37 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:38.409843 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c6091b9c-178e-4681-9687-31f7ada08a37 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:38.410300 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c6091b9c-178e-4681-9687-31f7ada08a37 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:38.410728 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c6091b9c-178e-4681-9687-31f7ada08a37 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:38.537772 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-c6091b9c-178e-4681-9687-31f7ada08a37 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:38.545877 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-c6091b9c-178e-4681-9687-31f7ada08a37 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:38.547414 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-c6091b9c-178e-4681-9687-31f7ada08a37 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:38.548492 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-c6091b9c-178e-4681-9687-31f7ada08a37 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1407 microversion: 2.20 time: 0.152933 Oct 03 14:52:38.549049 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 48/101] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:38 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:52:38.655619 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-3fd0726e-654c-4d3a-a216-b4d4b916780c tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:38.656227 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-3fd0726e-654c-4d3a-a216-b4d4b916780c tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:38.658048 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell0:SELECT=4 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:38.663395 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3fd0726e-654c-4d3a-a216-b4d4b916780c tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:38.663871 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3fd0726e-654c-4d3a-a216-b4d4b916780c tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:38.664302 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3fd0726e-654c-4d3a-a216-b4d4b916780c tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:38.664982 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3fd0726e-654c-4d3a-a216-b4d4b916780c tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:38.665460 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3fd0726e-654c-4d3a-a216-b4d4b916780c tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:38.665906 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3fd0726e-654c-4d3a-a216-b4d4b916780c tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:38.822107 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-34408dab-874e-44e6-8a25-562bc5df22d5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:38.822737 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-34408dab-874e-44e6-8a25-562bc5df22d5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:38.829820 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-34408dab-874e-44e6-8a25-562bc5df22d5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:38.830393 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-34408dab-874e-44e6-8a25-562bc5df22d5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:38.831005 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-34408dab-874e-44e6-8a25-562bc5df22d5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:38.831723 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-34408dab-874e-44e6-8a25-562bc5df22d5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:38.832251 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-34408dab-874e-44e6-8a25-562bc5df22d5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:38.832742 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-34408dab-874e-44e6-8a25-562bc5df22d5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:38.918558 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-3fd0726e-654c-4d3a-a216-b4d4b916780c tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:38.927688 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-3fd0726e-654c-4d3a-a216-b4d4b916780c tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1314 microversion: 2.1 time: 0.275656 Oct 03 14:52:38.928567 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 54/102] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:38 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:38.974407 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-34408dab-874e-44e6-8a25-562bc5df22d5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:38.982245 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-34408dab-874e-44e6-8a25-562bc5df22d5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1321 microversion: 2.1 time: 0.165830 Oct 03 14:52:38.982810 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 49/103] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:38 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:39.079937 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-d7ea23ea-2174-468d-b315-da520afa9e40 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:39.080477 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-d7ea23ea-2174-468d-b315-da520afa9e40 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:39.086464 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d7ea23ea-2174-468d-b315-da520afa9e40 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:39.086934 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d7ea23ea-2174-468d-b315-da520afa9e40 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:39.087356 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d7ea23ea-2174-468d-b315-da520afa9e40 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:39.088026 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d7ea23ea-2174-468d-b315-da520afa9e40 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:39.088471 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d7ea23ea-2174-468d-b315-da520afa9e40 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:39.088887 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d7ea23ea-2174-468d-b315-da520afa9e40 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:39.215664 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-d7ea23ea-2174-468d-b315-da520afa9e40 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:39.223997 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-d7ea23ea-2174-468d-b315-da520afa9e40 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 200 len: 1368 microversion: 2.1 time: 0.147857 Oct 03 14:52:39.224951 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 55/104] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:39 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:39.417751 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-bb22a6e1-610c-4e1c-9289-f6ea66a2b695 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:39.418355 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-bb22a6e1-610c-4e1c-9289-f6ea66a2b695 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:39.424166 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bb22a6e1-610c-4e1c-9289-f6ea66a2b695 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:39.424647 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bb22a6e1-610c-4e1c-9289-f6ea66a2b695 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:39.425072 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bb22a6e1-610c-4e1c-9289-f6ea66a2b695 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:39.425776 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bb22a6e1-610c-4e1c-9289-f6ea66a2b695 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:39.426505 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bb22a6e1-610c-4e1c-9289-f6ea66a2b695 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:39.426926 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bb22a6e1-610c-4e1c-9289-f6ea66a2b695 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:39.444284 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=100 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:39.491680 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-bb22a6e1-610c-4e1c-9289-f6ea66a2b695 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:39.499188 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-bb22a6e1-610c-4e1c-9289-f6ea66a2b695 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1303 microversion: 2.1 time: 0.085337 Oct 03 14:52:39.499745 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 50/105] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:39 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1303 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:39.573785 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-2b05cd3c-115c-40c0-a95a-1b43f2134afa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:39.574387 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-2b05cd3c-115c-40c0-a95a-1b43f2134afa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:39.580244 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2b05cd3c-115c-40c0-a95a-1b43f2134afa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:39.580725 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2b05cd3c-115c-40c0-a95a-1b43f2134afa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:39.581811 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2b05cd3c-115c-40c0-a95a-1b43f2134afa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:39.582490 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2b05cd3c-115c-40c0-a95a-1b43f2134afa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:39.583011 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2b05cd3c-115c-40c0-a95a-1b43f2134afa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:39.583430 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2b05cd3c-115c-40c0-a95a-1b43f2134afa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:39.714650 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-2b05cd3c-115c-40c0-a95a-1b43f2134afa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:39.723118 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-2b05cd3c-115c-40c0-a95a-1b43f2134afa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:39.724557 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-2b05cd3c-115c-40c0-a95a-1b43f2134afa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:39.725766 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-2b05cd3c-115c-40c0-a95a-1b43f2134afa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1407 microversion: 2.20 time: 0.155871 Oct 03 14:52:39.726320 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 56/106] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:39 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:52:39.951092 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-9dea3ea7-6f80-451e-a06f-6a8f1d9830ae tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:39.951698 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-9dea3ea7-6f80-451e-a06f-6a8f1d9830ae tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:39.958430 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9dea3ea7-6f80-451e-a06f-6a8f1d9830ae tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:39.958922 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9dea3ea7-6f80-451e-a06f-6a8f1d9830ae tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:39.959361 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9dea3ea7-6f80-451e-a06f-6a8f1d9830ae tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:39.960056 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9dea3ea7-6f80-451e-a06f-6a8f1d9830ae tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:39.960512 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9dea3ea7-6f80-451e-a06f-6a8f1d9830ae tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:39.960937 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9dea3ea7-6f80-451e-a06f-6a8f1d9830ae tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:40.006317 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-ea7ce38e-71a8-4d98-a95c-d7226c791126 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:40.007055 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-ea7ce38e-71a8-4d98-a95c-d7226c791126 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:40.013506 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ea7ce38e-71a8-4d98-a95c-d7226c791126 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:40.014107 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ea7ce38e-71a8-4d98-a95c-d7226c791126 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:40.014643 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ea7ce38e-71a8-4d98-a95c-d7226c791126 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:40.015432 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ea7ce38e-71a8-4d98-a95c-d7226c791126 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:40.016003 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ea7ce38e-71a8-4d98-a95c-d7226c791126 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:40.016526 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ea7ce38e-71a8-4d98-a95c-d7226c791126 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:40.097325 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-9dea3ea7-6f80-451e-a06f-6a8f1d9830ae tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:40.113783 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-9dea3ea7-6f80-451e-a06f-6a8f1d9830ae tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1314 microversion: 2.1 time: 0.166520 Oct 03 14:52:40.114369 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 51/107] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:39 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:40.154152 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-ea7ce38e-71a8-4d98-a95c-d7226c791126 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:40.161875 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-ea7ce38e-71a8-4d98-a95c-d7226c791126 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1321 microversion: 2.1 time: 0.160336 Oct 03 14:52:40.162442 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 57/108] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:40 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:40.247535 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-8930a140-bed3-4afe-b7cd-8be78a8b81ac tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:40.248072 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-8930a140-bed3-4afe-b7cd-8be78a8b81ac tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:40.254690 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8930a140-bed3-4afe-b7cd-8be78a8b81ac tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:40.255353 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8930a140-bed3-4afe-b7cd-8be78a8b81ac tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:40.255788 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8930a140-bed3-4afe-b7cd-8be78a8b81ac tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:40.256472 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8930a140-bed3-4afe-b7cd-8be78a8b81ac tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:40.256926 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8930a140-bed3-4afe-b7cd-8be78a8b81ac tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:40.257348 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8930a140-bed3-4afe-b7cd-8be78a8b81ac tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:40.387512 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-8930a140-bed3-4afe-b7cd-8be78a8b81ac tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:40.395270 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-8930a140-bed3-4afe-b7cd-8be78a8b81ac tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 200 len: 1368 microversion: 2.1 time: 0.151751 Oct 03 14:52:40.395970 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 52/109] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:40 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:40.522150 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-cc7cd68b-4bf1-4612-8e52-948f4803cf16 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:40.522672 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-cc7cd68b-4bf1-4612-8e52-948f4803cf16 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:40.528718 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cc7cd68b-4bf1-4612-8e52-948f4803cf16 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:40.529213 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cc7cd68b-4bf1-4612-8e52-948f4803cf16 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:40.529657 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cc7cd68b-4bf1-4612-8e52-948f4803cf16 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:40.530340 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cc7cd68b-4bf1-4612-8e52-948f4803cf16 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:40.530788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cc7cd68b-4bf1-4612-8e52-948f4803cf16 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:40.531212 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cc7cd68b-4bf1-4612-8e52-948f4803cf16 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:40.590467 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-cc7cd68b-4bf1-4612-8e52-948f4803cf16 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:40.598889 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-cc7cd68b-4bf1-4612-8e52-948f4803cf16 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1303 microversion: 2.1 time: 0.080696 Oct 03 14:52:40.599453 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 58/110] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:40 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1303 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:40.750544 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-e297e432-0018-4693-b4be-64ee2cc811e6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:40.751402 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-e297e432-0018-4693-b4be-64ee2cc811e6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:40.758223 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e297e432-0018-4693-b4be-64ee2cc811e6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:40.758700 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e297e432-0018-4693-b4be-64ee2cc811e6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:40.759586 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e297e432-0018-4693-b4be-64ee2cc811e6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:40.760260 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e297e432-0018-4693-b4be-64ee2cc811e6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:40.760712 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e297e432-0018-4693-b4be-64ee2cc811e6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:40.761125 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e297e432-0018-4693-b4be-64ee2cc811e6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:40.889359 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-e297e432-0018-4693-b4be-64ee2cc811e6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:40.897938 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-e297e432-0018-4693-b4be-64ee2cc811e6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:40.899358 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-e297e432-0018-4693-b4be-64ee2cc811e6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:40.900481 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-e297e432-0018-4693-b4be-64ee2cc811e6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1407 microversion: 2.20 time: 0.153977 Oct 03 14:52:40.901041 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 53/111] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:40 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:52:41.137106 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-92027afc-e304-45ca-9e80-ef5365b7a410 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:41.137971 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-92027afc-e304-45ca-9e80-ef5365b7a410 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:41.144624 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-92027afc-e304-45ca-9e80-ef5365b7a410 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:41.145192 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-92027afc-e304-45ca-9e80-ef5365b7a410 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:41.145658 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-92027afc-e304-45ca-9e80-ef5365b7a410 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:41.146347 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-92027afc-e304-45ca-9e80-ef5365b7a410 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:41.146797 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-92027afc-e304-45ca-9e80-ef5365b7a410 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:41.147445 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-92027afc-e304-45ca-9e80-ef5365b7a410 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:41.184319 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-34c5c48c-dec0-4f43-82d9-9f9b4c1d2a3b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:41.184931 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-34c5c48c-dec0-4f43-82d9-9f9b4c1d2a3b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:41.196871 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-34c5c48c-dec0-4f43-82d9-9f9b4c1d2a3b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:41.197806 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-34c5c48c-dec0-4f43-82d9-9f9b4c1d2a3b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:41.198281 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-34c5c48c-dec0-4f43-82d9-9f9b4c1d2a3b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:41.199005 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-34c5c48c-dec0-4f43-82d9-9f9b4c1d2a3b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:41.199828 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-34c5c48c-dec0-4f43-82d9-9f9b4c1d2a3b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:41.200475 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-34c5c48c-dec0-4f43-82d9-9f9b4c1d2a3b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:41.350510 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-92027afc-e304-45ca-9e80-ef5365b7a410 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:41.360508 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-92027afc-e304-45ca-9e80-ef5365b7a410 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1314 microversion: 2.1 time: 0.226943 Oct 03 14:52:41.361748 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 59/112] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:41 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:41.391223 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-34c5c48c-dec0-4f43-82d9-9f9b4c1d2a3b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:41.399747 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-34c5c48c-dec0-4f43-82d9-9f9b4c1d2a3b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1321 microversion: 2.1 time: 0.219289 Oct 03 14:52:41.400657 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 54/113] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:41 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:41.423209 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-1d21aaa8-5772-4d6d-a0d9-1f4d6b9b969b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:41.423819 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-1d21aaa8-5772-4d6d-a0d9-1f4d6b9b969b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:41.438999 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1d21aaa8-5772-4d6d-a0d9-1f4d6b9b969b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:41.439561 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1d21aaa8-5772-4d6d-a0d9-1f4d6b9b969b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:41.440620 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1d21aaa8-5772-4d6d-a0d9-1f4d6b9b969b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:41.441407 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1d21aaa8-5772-4d6d-a0d9-1f4d6b9b969b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:41.445975 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1d21aaa8-5772-4d6d-a0d9-1f4d6b9b969b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:41.446604 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1d21aaa8-5772-4d6d-a0d9-1f4d6b9b969b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:41.582804 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-1d21aaa8-5772-4d6d-a0d9-1f4d6b9b969b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:41.590688 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-1d21aaa8-5772-4d6d-a0d9-1f4d6b9b969b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 200 len: 1368 microversion: 2.1 time: 0.174020 Oct 03 14:52:41.591431 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 60/114] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:41 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:41.621621 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-f1925008-5c43-41a0-b354-637d059fc121 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:41.622232 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-f1925008-5c43-41a0-b354-637d059fc121 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:41.630725 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f1925008-5c43-41a0-b354-637d059fc121 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:41.631261 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f1925008-5c43-41a0-b354-637d059fc121 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:41.631686 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f1925008-5c43-41a0-b354-637d059fc121 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:41.632580 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f1925008-5c43-41a0-b354-637d059fc121 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:41.633039 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f1925008-5c43-41a0-b354-637d059fc121 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:41.633463 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f1925008-5c43-41a0-b354-637d059fc121 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:41.703423 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-f1925008-5c43-41a0-b354-637d059fc121 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:41.711484 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-f1925008-5c43-41a0-b354-637d059fc121 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1303 microversion: 2.1 time: 0.093621 Oct 03 14:52:41.712067 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 55/115] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:41 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:41.928740 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-fdd7b601-8716-4c37-ae3f-e094d4e915f1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:41.929355 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-fdd7b601-8716-4c37-ae3f-e094d4e915f1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:41.940533 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fdd7b601-8716-4c37-ae3f-e094d4e915f1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:41.941267 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fdd7b601-8716-4c37-ae3f-e094d4e915f1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:41.942105 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fdd7b601-8716-4c37-ae3f-e094d4e915f1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:41.943169 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fdd7b601-8716-4c37-ae3f-e094d4e915f1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:41.944057 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fdd7b601-8716-4c37-ae3f-e094d4e915f1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:41.944712 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fdd7b601-8716-4c37-ae3f-e094d4e915f1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:42.095981 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-fdd7b601-8716-4c37-ae3f-e094d4e915f1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:42.105032 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-fdd7b601-8716-4c37-ae3f-e094d4e915f1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:42.106518 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-fdd7b601-8716-4c37-ae3f-e094d4e915f1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:42.107624 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-fdd7b601-8716-4c37-ae3f-e094d4e915f1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1407 microversion: 2.20 time: 0.184719 Oct 03 14:52:42.108183 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 61/116] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:41 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:52:42.384329 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-3da25002-6734-4ce1-a687-4344538f3f7c tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:42.385684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-3da25002-6734-4ce1-a687-4344538f3f7c tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:42.392254 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3da25002-6734-4ce1-a687-4344538f3f7c tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:42.393001 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3da25002-6734-4ce1-a687-4344538f3f7c tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:42.394128 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3da25002-6734-4ce1-a687-4344538f3f7c tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:42.395030 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3da25002-6734-4ce1-a687-4344538f3f7c tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:42.395642 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3da25002-6734-4ce1-a687-4344538f3f7c tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:42.396218 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3da25002-6734-4ce1-a687-4344538f3f7c tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:42.428384 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-8133c6bc-e494-48b4-89d9-46c02607de0a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:42.429006 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-8133c6bc-e494-48b4-89d9-46c02607de0a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:42.443240 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8133c6bc-e494-48b4-89d9-46c02607de0a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:42.443240 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8133c6bc-e494-48b4-89d9-46c02607de0a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:42.443748 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8133c6bc-e494-48b4-89d9-46c02607de0a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:42.445874 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8133c6bc-e494-48b4-89d9-46c02607de0a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:42.445874 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8133c6bc-e494-48b4-89d9-46c02607de0a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:42.445874 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8133c6bc-e494-48b4-89d9-46c02607de0a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:42.728442 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-8133c6bc-e494-48b4-89d9-46c02607de0a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:42.751010 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-8133c6bc-e494-48b4-89d9-46c02607de0a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1321 microversion: 2.1 time: 0.325319 Oct 03 14:52:42.764441 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 62/117] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:42 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1321 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:42.779596 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-8a443b15-5a55-4f13-a417-8022a65e99e2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:42.782028 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-8a443b15-5a55-4f13-a417-8022a65e99e2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:42.793145 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8a443b15-5a55-4f13-a417-8022a65e99e2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:42.794002 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8a443b15-5a55-4f13-a417-8022a65e99e2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:42.794791 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8a443b15-5a55-4f13-a417-8022a65e99e2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:42.795915 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8a443b15-5a55-4f13-a417-8022a65e99e2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:42.796941 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8a443b15-5a55-4f13-a417-8022a65e99e2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:42.797586 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8a443b15-5a55-4f13-a417-8022a65e99e2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:42.889988 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-3da25002-6734-4ce1-a687-4344538f3f7c tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:42.898672 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-3da25002-6734-4ce1-a687-4344538f3f7c tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1314 microversion: 2.1 time: 0.518190 Oct 03 14:52:42.899578 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 56/118] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:42 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1314 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:42.913360 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-93dc4586-6d54-4288-b704-ba9751d88098 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:42.914353 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-93dc4586-6d54-4288-b704-ba9751d88098 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:42.922760 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-93dc4586-6d54-4288-b704-ba9751d88098 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:42.923255 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-93dc4586-6d54-4288-b704-ba9751d88098 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:42.923687 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-93dc4586-6d54-4288-b704-ba9751d88098 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:42.924929 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-93dc4586-6d54-4288-b704-ba9751d88098 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:42.925384 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-93dc4586-6d54-4288-b704-ba9751d88098 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:42.925849 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-93dc4586-6d54-4288-b704-ba9751d88098 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:42.950504 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-8a443b15-5a55-4f13-a417-8022a65e99e2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:42.960461 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-8a443b15-5a55-4f13-a417-8022a65e99e2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 200 len: 1368 microversion: 2.1 time: 0.191998 Oct 03 14:52:42.961522 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 63/119] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:42 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:43.036674 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-93dc4586-6d54-4288-b704-ba9751d88098 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:43.047442 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-93dc4586-6d54-4288-b704-ba9751d88098 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1291 microversion: 2.1 time: 0.145112 Oct 03 14:52:43.048153 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 57/120] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:42 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1291 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:43.137451 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-04ac84f0-6287-48ad-9bdb-ed2f215ce0a2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:43.138102 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-04ac84f0-6287-48ad-9bdb-ed2f215ce0a2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:43.144785 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-04ac84f0-6287-48ad-9bdb-ed2f215ce0a2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:43.145283 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-04ac84f0-6287-48ad-9bdb-ed2f215ce0a2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:43.145912 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-04ac84f0-6287-48ad-9bdb-ed2f215ce0a2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:43.146611 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-04ac84f0-6287-48ad-9bdb-ed2f215ce0a2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:43.147299 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-04ac84f0-6287-48ad-9bdb-ed2f215ce0a2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:43.147946 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-04ac84f0-6287-48ad-9bdb-ed2f215ce0a2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:43.335936 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-04ac84f0-6287-48ad-9bdb-ed2f215ce0a2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:43.345751 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-04ac84f0-6287-48ad-9bdb-ed2f215ce0a2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:43.351247 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-04ac84f0-6287-48ad-9bdb-ed2f215ce0a2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:43.352483 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-04ac84f0-6287-48ad-9bdb-ed2f215ce0a2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1407 microversion: 2.20 time: 0.222327 Oct 03 14:52:43.354556 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 64/121] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:43 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:52:43.543256 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-9823f331-08e9-4733-92c0-c4c11c41dbd4 req-b3242409-5d8c-43ce-9db9-2993e1cc79fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27879d6c-62f5-4281-b134-faecf706a2db", "tag": "abd33b94-cd03-47ad-bbbe-b38838da0555"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:43.554718 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-9823f331-08e9-4733-92c0-c4c11c41dbd4 req-b3242409-5d8c-43ce-9db9-2993e1cc79fe service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:43.554718 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-9823f331-08e9-4733-92c0-c4c11c41dbd4 req-b3242409-5d8c-43ce-9db9-2993e1cc79fe service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:43.559585 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-9823f331-08e9-4733-92c0-c4c11c41dbd4 req-b3242409-5d8c-43ce-9db9-2993e1cc79fe service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:43.571314 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-9823f331-08e9-4733-92c0-c4c11c41dbd4 req-b3242409-5d8c-43ce-9db9-2993e1cc79fe service nova] Creating event network-changed:abd33b94-cd03-47ad-bbbe-b38838da0555 for instance 27879d6c-62f5-4281-b134-faecf706a2db on hv-cinder-85987 Oct 03 14:52:43.576664 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-9823f331-08e9-4733-92c0-c4c11c41dbd4 req-b3242409-5d8c-43ce-9db9-2993e1cc79fe service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037469 Oct 03 14:52:43.577269 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 58/122] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:52:43.788623 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-8b69befa-7b02-4edc-b3c5-5e9d5d3a4cf7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:43.789325 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-8b69befa-7b02-4edc-b3c5-5e9d5d3a4cf7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:43.795586 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8b69befa-7b02-4edc-b3c5-5e9d5d3a4cf7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:43.796153 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8b69befa-7b02-4edc-b3c5-5e9d5d3a4cf7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:43.796742 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8b69befa-7b02-4edc-b3c5-5e9d5d3a4cf7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:43.797513 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8b69befa-7b02-4edc-b3c5-5e9d5d3a4cf7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:43.798027 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8b69befa-7b02-4edc-b3c5-5e9d5d3a4cf7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:43.798491 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8b69befa-7b02-4edc-b3c5-5e9d5d3a4cf7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:43.925570 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-14582061-9acb-4597-8b49-3b12519dbd2d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:43.926278 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-14582061-9acb-4597-8b49-3b12519dbd2d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:43.937085 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-14582061-9acb-4597-8b49-3b12519dbd2d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:43.938323 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-14582061-9acb-4597-8b49-3b12519dbd2d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:43.938784 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-14582061-9acb-4597-8b49-3b12519dbd2d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:43.939511 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-14582061-9acb-4597-8b49-3b12519dbd2d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:43.940036 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-14582061-9acb-4597-8b49-3b12519dbd2d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:43.940469 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-14582061-9acb-4597-8b49-3b12519dbd2d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:43.965049 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-8b69befa-7b02-4edc-b3c5-5e9d5d3a4cf7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:43.977675 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-8b69befa-7b02-4edc-b3c5-5e9d5d3a4cf7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1321 microversion: 2.1 time: 0.192800 Oct 03 14:52:43.978930 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 65/123] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:43 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1321 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:43.983952 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-2fd2ca52-774a-45c3-b7e5-66b9658db4ac tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:43.984815 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-2fd2ca52-774a-45c3-b7e5-66b9658db4ac tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:43.992888 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2fd2ca52-774a-45c3-b7e5-66b9658db4ac tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:43.993774 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2fd2ca52-774a-45c3-b7e5-66b9658db4ac tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:43.994583 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2fd2ca52-774a-45c3-b7e5-66b9658db4ac tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:43.995889 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2fd2ca52-774a-45c3-b7e5-66b9658db4ac tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:43.996660 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2fd2ca52-774a-45c3-b7e5-66b9658db4ac tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:43.997449 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2fd2ca52-774a-45c3-b7e5-66b9658db4ac tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:44.018656 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=100 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:44.129792 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-14582061-9acb-4597-8b49-3b12519dbd2d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:44.137886 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-14582061-9acb-4597-8b49-3b12519dbd2d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1314 microversion: 2.1 time: 0.217990 Oct 03 14:52:44.138636 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 59/124] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:43 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:44.143949 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-2fd2ca52-774a-45c3-b7e5-66b9658db4ac tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:44.144357 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-b1461422-5fb8-4889-9fee-aa7463440220 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:44.145054 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-b1461422-5fb8-4889-9fee-aa7463440220 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:44.151007 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b1461422-5fb8-4889-9fee-aa7463440220 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:44.151763 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b1461422-5fb8-4889-9fee-aa7463440220 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:44.152391 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-2fd2ca52-774a-45c3-b7e5-66b9658db4ac tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 200 len: 1368 microversion: 2.1 time: 0.172084 Oct 03 14:52:44.152724 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b1461422-5fb8-4889-9fee-aa7463440220 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:44.153682 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b1461422-5fb8-4889-9fee-aa7463440220 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:44.154351 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b1461422-5fb8-4889-9fee-aa7463440220 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:44.154872 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b1461422-5fb8-4889-9fee-aa7463440220 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:44.162358 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 66/125] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:43 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:44.216653 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-b1461422-5fb8-4889-9fee-aa7463440220 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:44.226043 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-b1461422-5fb8-4889-9fee-aa7463440220 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1291 microversion: 2.1 time: 0.086237 Oct 03 14:52:44.226613 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 60/126] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:44 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1291 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:44.380084 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-3dab27aa-372e-4b32-8e14-641fa2dcdc1b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:44.380799 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-3dab27aa-372e-4b32-8e14-641fa2dcdc1b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:44.386789 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3dab27aa-372e-4b32-8e14-641fa2dcdc1b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:44.387346 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3dab27aa-372e-4b32-8e14-641fa2dcdc1b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:44.387859 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3dab27aa-372e-4b32-8e14-641fa2dcdc1b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:44.388607 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3dab27aa-372e-4b32-8e14-641fa2dcdc1b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:44.389135 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3dab27aa-372e-4b32-8e14-641fa2dcdc1b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:44.389663 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3dab27aa-372e-4b32-8e14-641fa2dcdc1b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:44.539820 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-3dab27aa-372e-4b32-8e14-641fa2dcdc1b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:44.548274 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-3dab27aa-372e-4b32-8e14-641fa2dcdc1b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:44.550408 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-3dab27aa-372e-4b32-8e14-641fa2dcdc1b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:44.551523 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-3dab27aa-372e-4b32-8e14-641fa2dcdc1b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1407 microversion: 2.20 time: 0.175868 Oct 03 14:52:44.552046 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 67/127] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:44 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:52:45.002957 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-d4708140-aa73-494c-bf13-b96070da42a7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:45.003569 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-d4708140-aa73-494c-bf13-b96070da42a7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:45.041281 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d4708140-aa73-494c-bf13-b96070da42a7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:45.041905 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d4708140-aa73-494c-bf13-b96070da42a7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:45.042432 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d4708140-aa73-494c-bf13-b96070da42a7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:45.047380 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d4708140-aa73-494c-bf13-b96070da42a7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:45.048129 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d4708140-aa73-494c-bf13-b96070da42a7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:45.052617 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d4708140-aa73-494c-bf13-b96070da42a7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:45.163226 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-ba1f81fc-ba0e-4359-b3ea-6273d78e8f13 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:45.164721 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-ba1f81fc-ba0e-4359-b3ea-6273d78e8f13 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:45.177583 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ba1f81fc-ba0e-4359-b3ea-6273d78e8f13 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:45.178277 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ba1f81fc-ba0e-4359-b3ea-6273d78e8f13 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:45.180311 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ba1f81fc-ba0e-4359-b3ea-6273d78e8f13 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:45.182476 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ba1f81fc-ba0e-4359-b3ea-6273d78e8f13 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:45.184714 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ba1f81fc-ba0e-4359-b3ea-6273d78e8f13 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:45.185381 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ba1f81fc-ba0e-4359-b3ea-6273d78e8f13 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:45.715940 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-ba1f81fc-ba0e-4359-b3ea-6273d78e8f13 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:45.736358 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-ba1f81fc-ba0e-4359-b3ea-6273d78e8f13 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1314 microversion: 2.1 time: 0.578553 Oct 03 14:52:45.756700 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 68/128] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:45 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1314 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:45.770381 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-380dfd54-3f02-4d11-ba54-8722671c7e45 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:45.774895 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-380dfd54-3f02-4d11-ba54-8722671c7e45 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:45.790520 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-380dfd54-3f02-4d11-ba54-8722671c7e45 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:45.793254 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-380dfd54-3f02-4d11-ba54-8722671c7e45 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:45.793880 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-380dfd54-3f02-4d11-ba54-8722671c7e45 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:45.810573 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-380dfd54-3f02-4d11-ba54-8722671c7e45 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:45.811078 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-380dfd54-3f02-4d11-ba54-8722671c7e45 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:45.823505 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-380dfd54-3f02-4d11-ba54-8722671c7e45 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:45.951660 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-d4708140-aa73-494c-bf13-b96070da42a7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:45.981571 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-d4708140-aa73-494c-bf13-b96070da42a7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1321 microversion: 2.1 time: 0.982308 Oct 03 14:52:45.987430 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 61/129] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:44 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1321 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:45.996708 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-d7d6ce2f-c3fd-4db8-8e1b-e00543557e0a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:45.998779 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-d7d6ce2f-c3fd-4db8-8e1b-e00543557e0a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:46.013182 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d7d6ce2f-c3fd-4db8-8e1b-e00543557e0a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:46.014553 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d7d6ce2f-c3fd-4db8-8e1b-e00543557e0a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:46.014999 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d7d6ce2f-c3fd-4db8-8e1b-e00543557e0a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:46.015702 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d7d6ce2f-c3fd-4db8-8e1b-e00543557e0a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:46.016199 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d7d6ce2f-c3fd-4db8-8e1b-e00543557e0a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:46.016560 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d7d6ce2f-c3fd-4db8-8e1b-e00543557e0a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:46.249165 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-d7d6ce2f-c3fd-4db8-8e1b-e00543557e0a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:46.263259 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-d7d6ce2f-c3fd-4db8-8e1b-e00543557e0a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1291 microversion: 2.1 time: 0.274407 Oct 03 14:52:46.264926 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 62/130] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:45 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1291 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:46.276151 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-ca6de1e3-d872-4748-8ed1-c1f03389bf44 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:46.280065 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-ca6de1e3-d872-4748-8ed1-c1f03389bf44 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:46.297482 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ca6de1e3-d872-4748-8ed1-c1f03389bf44 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:46.299184 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ca6de1e3-d872-4748-8ed1-c1f03389bf44 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:46.303516 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ca6de1e3-d872-4748-8ed1-c1f03389bf44 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:46.304419 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ca6de1e3-d872-4748-8ed1-c1f03389bf44 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:46.305041 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ca6de1e3-d872-4748-8ed1-c1f03389bf44 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:46.305675 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ca6de1e3-d872-4748-8ed1-c1f03389bf44 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:46.349992 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-380dfd54-3f02-4d11-ba54-8722671c7e45 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:46.358518 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-380dfd54-3f02-4d11-ba54-8722671c7e45 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 200 len: 1368 microversion: 2.1 time: 0.598373 Oct 03 14:52:46.362363 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 69/131] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:45 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 1368 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:46.501152 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-745617a5-90f3-46cf-97af-18bd340d8bb3 req-6f11efc1-8efa-4db7-8247-f54475ca53d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b", "name": "network-vif-plugged", "status": "completed", "tag": "2e72d55c-b330-49d5-9e42-f12cbb9f7a3b"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:46.516527 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-745617a5-90f3-46cf-97af-18bd340d8bb3 req-6f11efc1-8efa-4db7-8247-f54475ca53d3 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:46.517396 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-745617a5-90f3-46cf-97af-18bd340d8bb3 req-6f11efc1-8efa-4db7-8247-f54475ca53d3 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:46.518134 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-745617a5-90f3-46cf-97af-18bd340d8bb3 req-6f11efc1-8efa-4db7-8247-f54475ca53d3 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:46.536000 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-745617a5-90f3-46cf-97af-18bd340d8bb3 req-6f11efc1-8efa-4db7-8247-f54475ca53d3 service nova] Creating event network-vif-plugged:2e72d55c-b330-49d5-9e42-f12cbb9f7a3b for instance 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b on hv-cinder-85987 Oct 03 14:52:46.542660 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-745617a5-90f3-46cf-97af-18bd340d8bb3 req-6f11efc1-8efa-4db7-8247-f54475ca53d3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170591 Oct 03 14:52:46.543675 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 70/132] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:52:46.762566 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-9a2ef3fa-110b-40a1-a171-f1f8ec96e292 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:46.763612 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-9a2ef3fa-110b-40a1-a171-f1f8ec96e292 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:46.771273 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9a2ef3fa-110b-40a1-a171-f1f8ec96e292 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:46.771979 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9a2ef3fa-110b-40a1-a171-f1f8ec96e292 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:46.772657 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9a2ef3fa-110b-40a1-a171-f1f8ec96e292 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:46.773587 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9a2ef3fa-110b-40a1-a171-f1f8ec96e292 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:46.774241 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9a2ef3fa-110b-40a1-a171-f1f8ec96e292 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:46.774860 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9a2ef3fa-110b-40a1-a171-f1f8ec96e292 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:46.976293 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-9a2ef3fa-110b-40a1-a171-f1f8ec96e292 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:46.984984 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-9a2ef3fa-110b-40a1-a171-f1f8ec96e292 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1314 microversion: 2.1 time: 0.226613 Oct 03 14:52:46.985702 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 71/133] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:46 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:47.004038 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-ca6de1e3-d872-4748-8ed1-c1f03389bf44 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:47.016117 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-4a507d84-2d89-41fd-aabf-9168718696eb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:47.016761 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-4a507d84-2d89-41fd-aabf-9168718696eb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:47.020189 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-ca6de1e3-d872-4748-8ed1-c1f03389bf44 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:47.023415 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-ca6de1e3-d872-4748-8ed1-c1f03389bf44 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:47.024668 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-ca6de1e3-d872-4748-8ed1-c1f03389bf44 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1407 microversion: 2.20 time: 0.757974 Oct 03 14:52:47.024951 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4a507d84-2d89-41fd-aabf-9168718696eb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:47.025429 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 63/134] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:46 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1407 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:52:47.029971 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4a507d84-2d89-41fd-aabf-9168718696eb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:47.030634 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4a507d84-2d89-41fd-aabf-9168718696eb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:47.032087 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4a507d84-2d89-41fd-aabf-9168718696eb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:47.032828 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4a507d84-2d89-41fd-aabf-9168718696eb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:47.033463 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4a507d84-2d89-41fd-aabf-9168718696eb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:47.168618 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-4a507d84-2d89-41fd-aabf-9168718696eb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:47.183904 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-4a507d84-2d89-41fd-aabf-9168718696eb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1321 microversion: 2.1 time: 0.170457 Oct 03 14:52:47.202057 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 72/135] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:47 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:47.297331 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-ebf4d628-991c-44a5-bbd8-9a14a61d5931 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:47.300072 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-ebf4d628-991c-44a5-bbd8-9a14a61d5931 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:47.307069 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ebf4d628-991c-44a5-bbd8-9a14a61d5931 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:47.307555 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ebf4d628-991c-44a5-bbd8-9a14a61d5931 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:47.307981 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ebf4d628-991c-44a5-bbd8-9a14a61d5931 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:47.308673 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ebf4d628-991c-44a5-bbd8-9a14a61d5931 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:47.309107 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ebf4d628-991c-44a5-bbd8-9a14a61d5931 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:47.309547 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ebf4d628-991c-44a5-bbd8-9a14a61d5931 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:47.384185 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-2b05949d-ae21-4d70-9c74-bfd60a0f20f4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:47.384912 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-2b05949d-ae21-4d70-9c74-bfd60a0f20f4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:47.392107 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2b05949d-ae21-4d70-9c74-bfd60a0f20f4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:47.393416 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2b05949d-ae21-4d70-9c74-bfd60a0f20f4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:47.393902 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2b05949d-ae21-4d70-9c74-bfd60a0f20f4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:47.394592 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2b05949d-ae21-4d70-9c74-bfd60a0f20f4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:47.395074 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2b05949d-ae21-4d70-9c74-bfd60a0f20f4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:47.395493 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2b05949d-ae21-4d70-9c74-bfd60a0f20f4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:47.475808 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-ebf4d628-991c-44a5-bbd8-9a14a61d5931 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:47.484084 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-ebf4d628-991c-44a5-bbd8-9a14a61d5931 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1358 microversion: 2.1 time: 0.194272 Oct 03 14:52:47.484656 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 64/136] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:47 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:47.555026 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-2b05949d-ae21-4d70-9c74-bfd60a0f20f4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:47.562904 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-2b05949d-ae21-4d70-9c74-bfd60a0f20f4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 200 len: 1368 microversion: 2.1 time: 0.182519 Oct 03 14:52:47.563470 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 73/137] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:47 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 1368 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:48.009038 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-ce770ad3-4dd6-4016-ba20-e77dd6b990c3 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:48.009698 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-ce770ad3-4dd6-4016-ba20-e77dd6b990c3 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:48.015727 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ce770ad3-4dd6-4016-ba20-e77dd6b990c3 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:48.016206 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ce770ad3-4dd6-4016-ba20-e77dd6b990c3 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:48.016652 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ce770ad3-4dd6-4016-ba20-e77dd6b990c3 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:48.017310 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ce770ad3-4dd6-4016-ba20-e77dd6b990c3 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:48.017781 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ce770ad3-4dd6-4016-ba20-e77dd6b990c3 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:48.018199 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ce770ad3-4dd6-4016-ba20-e77dd6b990c3 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:48.052801 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-48cc6649-bcc8-4907-b3d9-e0cef21fc620 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:48.053346 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-48cc6649-bcc8-4907-b3d9-e0cef21fc620 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:48.059391 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-48cc6649-bcc8-4907-b3d9-e0cef21fc620 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:48.059869 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-48cc6649-bcc8-4907-b3d9-e0cef21fc620 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:48.060774 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-48cc6649-bcc8-4907-b3d9-e0cef21fc620 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:48.061685 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-48cc6649-bcc8-4907-b3d9-e0cef21fc620 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:48.062301 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-48cc6649-bcc8-4907-b3d9-e0cef21fc620 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:48.062725 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-48cc6649-bcc8-4907-b3d9-e0cef21fc620 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:48.156987 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-ce770ad3-4dd6-4016-ba20-e77dd6b990c3 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:48.166284 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-ce770ad3-4dd6-4016-ba20-e77dd6b990c3 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1314 microversion: 2.1 time: 0.160977 Oct 03 14:52:48.166857 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 65/138] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:48 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:48.201204 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-48cc6649-bcc8-4907-b3d9-e0cef21fc620 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:48.208471 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-da096ee5-6aca-4722-8023-a34d352e2805 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:48.209209 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-da096ee5-6aca-4722-8023-a34d352e2805 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:48.210326 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-48cc6649-bcc8-4907-b3d9-e0cef21fc620 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:48.211749 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-48cc6649-bcc8-4907-b3d9-e0cef21fc620 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:48.212846 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-48cc6649-bcc8-4907-b3d9-e0cef21fc620 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1407 microversion: 2.20 time: 0.164503 Oct 03 14:52:48.213391 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 74/139] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:48 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:52:48.215328 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-da096ee5-6aca-4722-8023-a34d352e2805 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:48.215813 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-da096ee5-6aca-4722-8023-a34d352e2805 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:48.216242 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-da096ee5-6aca-4722-8023-a34d352e2805 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:48.216921 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-da096ee5-6aca-4722-8023-a34d352e2805 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:48.217370 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-da096ee5-6aca-4722-8023-a34d352e2805 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:48.217815 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-da096ee5-6aca-4722-8023-a34d352e2805 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:48.359471 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-da096ee5-6aca-4722-8023-a34d352e2805 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:48.367002 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-da096ee5-6aca-4722-8023-a34d352e2805 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1321 microversion: 2.1 time: 0.162770 Oct 03 14:52:48.367559 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 66/140] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:48 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:48.509067 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-45eae5ad-b7b0-4359-936a-68b7569d11c5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:48.509697 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-45eae5ad-b7b0-4359-936a-68b7569d11c5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:48.515571 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-45eae5ad-b7b0-4359-936a-68b7569d11c5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:48.516046 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-45eae5ad-b7b0-4359-936a-68b7569d11c5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:48.516473 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-45eae5ad-b7b0-4359-936a-68b7569d11c5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:48.517153 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-45eae5ad-b7b0-4359-936a-68b7569d11c5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:48.517622 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-45eae5ad-b7b0-4359-936a-68b7569d11c5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:48.518601 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-45eae5ad-b7b0-4359-936a-68b7569d11c5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:48.591997 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-02de27b1-0476-4646-8341-283df2cb7259 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:48.592601 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-02de27b1-0476-4646-8341-283df2cb7259 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:48.598852 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-02de27b1-0476-4646-8341-283df2cb7259 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:48.599335 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-02de27b1-0476-4646-8341-283df2cb7259 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:48.599764 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-02de27b1-0476-4646-8341-283df2cb7259 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:48.600484 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-02de27b1-0476-4646-8341-283df2cb7259 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:48.600946 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-02de27b1-0476-4646-8341-283df2cb7259 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:48.601395 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-02de27b1-0476-4646-8341-283df2cb7259 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:48.645209 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-45eae5ad-b7b0-4359-936a-68b7569d11c5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:48.652864 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-45eae5ad-b7b0-4359-936a-68b7569d11c5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1358 microversion: 2.1 time: 0.147551 Oct 03 14:52:48.653437 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 75/141] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:48 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:48.726801 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-02de27b1-0476-4646-8341-283df2cb7259 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:48.730276 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=100 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:48.735254 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-02de27b1-0476-4646-8341-283df2cb7259 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 200 len: 1368 microversion: 2.1 time: 0.147035 Oct 03 14:52:48.735804 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 67/142] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:48 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:49.188012 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-96eee81a-52f5-4b12-8be1-7f4916d077d7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:49.188613 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-96eee81a-52f5-4b12-8be1-7f4916d077d7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:49.195100 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-96eee81a-52f5-4b12-8be1-7f4916d077d7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:49.195571 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-96eee81a-52f5-4b12-8be1-7f4916d077d7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:49.195994 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-96eee81a-52f5-4b12-8be1-7f4916d077d7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:49.196668 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-96eee81a-52f5-4b12-8be1-7f4916d077d7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:49.197109 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-96eee81a-52f5-4b12-8be1-7f4916d077d7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:49.197548 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-96eee81a-52f5-4b12-8be1-7f4916d077d7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:49.244716 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-3ada9354-1f48-42e3-bb96-fa7404bcddc1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:49.245378 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-3ada9354-1f48-42e3-bb96-fa7404bcddc1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:49.251516 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3ada9354-1f48-42e3-bb96-fa7404bcddc1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:49.252102 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3ada9354-1f48-42e3-bb96-fa7404bcddc1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:49.253128 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3ada9354-1f48-42e3-bb96-fa7404bcddc1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:49.253917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3ada9354-1f48-42e3-bb96-fa7404bcddc1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:49.254460 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3ada9354-1f48-42e3-bb96-fa7404bcddc1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:49.254959 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3ada9354-1f48-42e3-bb96-fa7404bcddc1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:49.326526 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-96eee81a-52f5-4b12-8be1-7f4916d077d7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:49.334047 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-96eee81a-52f5-4b12-8be1-7f4916d077d7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1314 microversion: 2.1 time: 0.149794 Oct 03 14:52:49.334611 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 76/143] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:49 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:49.387166 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-3ada9354-1f48-42e3-bb96-fa7404bcddc1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:49.389080 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-3ac7671a-6e4c-412b-8b45-6dbc8bf87f7c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:49.389720 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-3ac7671a-6e4c-412b-8b45-6dbc8bf87f7c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:49.395318 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-3ada9354-1f48-42e3-bb96-fa7404bcddc1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:49.395460 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3ac7671a-6e4c-412b-8b45-6dbc8bf87f7c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:49.395891 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3ac7671a-6e4c-412b-8b45-6dbc8bf87f7c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:49.396315 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3ac7671a-6e4c-412b-8b45-6dbc8bf87f7c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:49.396735 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-3ada9354-1f48-42e3-bb96-fa7404bcddc1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:49.396989 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3ac7671a-6e4c-412b-8b45-6dbc8bf87f7c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:49.397436 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3ac7671a-6e4c-412b-8b45-6dbc8bf87f7c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:49.397861 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-3ada9354-1f48-42e3-bb96-fa7404bcddc1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1407 microversion: 2.20 time: 0.157090 Oct 03 14:52:49.397968 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3ac7671a-6e4c-412b-8b45-6dbc8bf87f7c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:49.398414 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 68/144] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:49 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:52:49.540706 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-3ac7671a-6e4c-412b-8b45-6dbc8bf87f7c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:49.556155 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-3ac7671a-6e4c-412b-8b45-6dbc8bf87f7c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1321 microversion: 2.1 time: 0.169596 Oct 03 14:52:49.556155 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 77/145] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:49 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:49.675285 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-8c9064ae-2513-4ac6-851f-48a4dedd7efc tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:49.675890 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-8c9064ae-2513-4ac6-851f-48a4dedd7efc tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:49.681782 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8c9064ae-2513-4ac6-851f-48a4dedd7efc tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:49.682260 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8c9064ae-2513-4ac6-851f-48a4dedd7efc tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:49.682691 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8c9064ae-2513-4ac6-851f-48a4dedd7efc tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:49.683368 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8c9064ae-2513-4ac6-851f-48a4dedd7efc tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:49.683824 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8c9064ae-2513-4ac6-851f-48a4dedd7efc tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:49.684243 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8c9064ae-2513-4ac6-851f-48a4dedd7efc tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:49.758285 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-57bd1d16-0f6b-4b23-9722-5c2861d82953 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:49.758285 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-57bd1d16-0f6b-4b23-9722-5c2861d82953 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:49.764044 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-57bd1d16-0f6b-4b23-9722-5c2861d82953 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:49.764532 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-57bd1d16-0f6b-4b23-9722-5c2861d82953 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:49.765068 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-57bd1d16-0f6b-4b23-9722-5c2861d82953 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:49.765775 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-57bd1d16-0f6b-4b23-9722-5c2861d82953 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:49.766224 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-57bd1d16-0f6b-4b23-9722-5c2861d82953 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:49.766643 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-57bd1d16-0f6b-4b23-9722-5c2861d82953 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:49.808467 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-8c9064ae-2513-4ac6-851f-48a4dedd7efc tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:49.816084 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-8c9064ae-2513-4ac6-851f-48a4dedd7efc tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1358 microversion: 2.1 time: 0.144645 Oct 03 14:52:49.816651 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 69/146] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:49 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:49.893515 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-57bd1d16-0f6b-4b23-9722-5c2861d82953 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:49.900898 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-57bd1d16-0f6b-4b23-9722-5c2861d82953 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 200 len: 1368 microversion: 2.1 time: 0.147311 Oct 03 14:52:49.901459 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 78/147] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:49 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:50.359501 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-d6a6a27f-e4a0-4168-a7e6-e2a3d4260bdc tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:50.360108 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-d6a6a27f-e4a0-4168-a7e6-e2a3d4260bdc tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:50.366439 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d6a6a27f-e4a0-4168-a7e6-e2a3d4260bdc tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:50.366923 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d6a6a27f-e4a0-4168-a7e6-e2a3d4260bdc tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:50.367354 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d6a6a27f-e4a0-4168-a7e6-e2a3d4260bdc tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:50.368034 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d6a6a27f-e4a0-4168-a7e6-e2a3d4260bdc tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:50.368488 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d6a6a27f-e4a0-4168-a7e6-e2a3d4260bdc tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:50.368912 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d6a6a27f-e4a0-4168-a7e6-e2a3d4260bdc tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:50.422328 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-7e37ae3c-9875-4772-9fb8-82341b94f98a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:50.422935 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-7e37ae3c-9875-4772-9fb8-82341b94f98a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:50.426499 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_api:SELECT=100 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:50.430357 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7e37ae3c-9875-4772-9fb8-82341b94f98a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:50.430842 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7e37ae3c-9875-4772-9fb8-82341b94f98a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:50.431278 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7e37ae3c-9875-4772-9fb8-82341b94f98a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:50.431964 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7e37ae3c-9875-4772-9fb8-82341b94f98a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:50.432423 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7e37ae3c-9875-4772-9fb8-82341b94f98a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:50.432843 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7e37ae3c-9875-4772-9fb8-82341b94f98a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:50.497911 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-d6a6a27f-e4a0-4168-a7e6-e2a3d4260bdc tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:50.507179 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-d6a6a27f-e4a0-4168-a7e6-e2a3d4260bdc tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1314 microversion: 2.1 time: 0.151516 Oct 03 14:52:50.507977 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 70/148] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:50 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:50.561454 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-7e37ae3c-9875-4772-9fb8-82341b94f98a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:50.569806 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-7e37ae3c-9875-4772-9fb8-82341b94f98a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:50.571242 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-7e37ae3c-9875-4772-9fb8-82341b94f98a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:50.572350 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-7e37ae3c-9875-4772-9fb8-82341b94f98a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1407 microversion: 2.20 time: 0.153942 Oct 03 14:52:50.572901 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 79/149] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:50 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:52:50.578122 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-25f0e8b8-d2c5-47df-ab38-93aae5abd103 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:50.579101 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-25f0e8b8-d2c5-47df-ab38-93aae5abd103 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:50.585922 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-25f0e8b8-d2c5-47df-ab38-93aae5abd103 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:50.586531 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-25f0e8b8-d2c5-47df-ab38-93aae5abd103 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:50.587084 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-25f0e8b8-d2c5-47df-ab38-93aae5abd103 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:50.587874 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-25f0e8b8-d2c5-47df-ab38-93aae5abd103 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:50.588445 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-25f0e8b8-d2c5-47df-ab38-93aae5abd103 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:50.589010 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-25f0e8b8-d2c5-47df-ab38-93aae5abd103 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:50.724567 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-25f0e8b8-d2c5-47df-ab38-93aae5abd103 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:50.732473 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-25f0e8b8-d2c5-47df-ab38-93aae5abd103 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1321 microversion: 2.1 time: 0.158099 Oct 03 14:52:50.733038 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 71/150] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:50 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:50.802804 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-7a676e9e-7a7d-4bea-a133-9ea0da0323ec req-0ddba3bc-3de0-4aec-88bf-b3b908997778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e89e5bd3-ef0d-4314-b688-10af4dbf02a8", "name": "network-vif-plugged", "status": "completed", "tag": "9bdcc1e0-93a1-4a48-839a-e6c7d4339e25"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:50.812925 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-7a676e9e-7a7d-4bea-a133-9ea0da0323ec req-0ddba3bc-3de0-4aec-88bf-b3b908997778 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:50.813614 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-7a676e9e-7a7d-4bea-a133-9ea0da0323ec req-0ddba3bc-3de0-4aec-88bf-b3b908997778 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:50.814047 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-7a676e9e-7a7d-4bea-a133-9ea0da0323ec req-0ddba3bc-3de0-4aec-88bf-b3b908997778 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:50.825747 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-7a676e9e-7a7d-4bea-a133-9ea0da0323ec req-0ddba3bc-3de0-4aec-88bf-b3b908997778 service nova] Creating event network-vif-plugged:9bdcc1e0-93a1-4a48-839a-e6c7d4339e25 for instance e89e5bd3-ef0d-4314-b688-10af4dbf02a8 on hv-cinder-85987 Oct 03 14:52:50.831382 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-7a676e9e-7a7d-4bea-a133-9ea0da0323ec req-0ddba3bc-3de0-4aec-88bf-b3b908997778 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032384 Oct 03 14:52:50.831967 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 80/151] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:52:50.838932 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-6f67e2be-e24d-43bf-b25a-52ab4bf288a5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:50.839547 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-6f67e2be-e24d-43bf-b25a-52ab4bf288a5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:50.845582 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6f67e2be-e24d-43bf-b25a-52ab4bf288a5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:50.846065 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6f67e2be-e24d-43bf-b25a-52ab4bf288a5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:50.846500 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6f67e2be-e24d-43bf-b25a-52ab4bf288a5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:50.847180 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6f67e2be-e24d-43bf-b25a-52ab4bf288a5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:50.847628 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6f67e2be-e24d-43bf-b25a-52ab4bf288a5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:50.848317 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6f67e2be-e24d-43bf-b25a-52ab4bf288a5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:50.924836 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-4b1850eb-7cd6-4040-8365-4dc7f918bbaa tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:50.925677 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-4b1850eb-7cd6-4040-8365-4dc7f918bbaa tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:50.931816 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4b1850eb-7cd6-4040-8365-4dc7f918bbaa tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:50.932367 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4b1850eb-7cd6-4040-8365-4dc7f918bbaa tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:50.932866 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4b1850eb-7cd6-4040-8365-4dc7f918bbaa tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:50.933653 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4b1850eb-7cd6-4040-8365-4dc7f918bbaa tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:50.934181 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4b1850eb-7cd6-4040-8365-4dc7f918bbaa tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:50.934684 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4b1850eb-7cd6-4040-8365-4dc7f918bbaa tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:50.975380 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-6f67e2be-e24d-43bf-b25a-52ab4bf288a5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:50.983050 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-6f67e2be-e24d-43bf-b25a-52ab4bf288a5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1358 microversion: 2.1 time: 0.147934 Oct 03 14:52:50.983613 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 72/152] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:50 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:51.060861 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-4b1850eb-7cd6-4040-8365-4dc7f918bbaa tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:51.068968 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-4b1850eb-7cd6-4040-8365-4dc7f918bbaa tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 200 len: 1368 microversion: 2.1 time: 0.148620 Oct 03 14:52:51.069541 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 81/153] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:50 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:51.529047 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-72bfb5d7-352a-4286-9647-cc0f23acd016 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:51.529694 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-72bfb5d7-352a-4286-9647-cc0f23acd016 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:51.536010 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-72bfb5d7-352a-4286-9647-cc0f23acd016 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:51.536491 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-72bfb5d7-352a-4286-9647-cc0f23acd016 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:51.536926 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-72bfb5d7-352a-4286-9647-cc0f23acd016 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:51.537643 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-72bfb5d7-352a-4286-9647-cc0f23acd016 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:51.538115 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-72bfb5d7-352a-4286-9647-cc0f23acd016 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:51.538517 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-72bfb5d7-352a-4286-9647-cc0f23acd016 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:51.598994 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-85742ce4-52cd-4544-aaa6-a064e1012aea tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:51.599653 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-85742ce4-52cd-4544-aaa6-a064e1012aea tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:51.606377 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-85742ce4-52cd-4544-aaa6-a064e1012aea tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:51.607438 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-85742ce4-52cd-4544-aaa6-a064e1012aea tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:51.607438 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-85742ce4-52cd-4544-aaa6-a064e1012aea tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:51.608156 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-85742ce4-52cd-4544-aaa6-a064e1012aea tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:51.608675 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-85742ce4-52cd-4544-aaa6-a064e1012aea tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:51.609162 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-85742ce4-52cd-4544-aaa6-a064e1012aea tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:51.682108 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-72bfb5d7-352a-4286-9647-cc0f23acd016 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:51.690863 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-72bfb5d7-352a-4286-9647-cc0f23acd016 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1314 microversion: 2.1 time: 0.165556 Oct 03 14:52:51.691448 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 73/154] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:51 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:51.755313 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-4f1d503b-24cb-4463-9dba-d1ba2d910b1d tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:51.756314 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-4f1d503b-24cb-4463-9dba-d1ba2d910b1d tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:51.762996 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4f1d503b-24cb-4463-9dba-d1ba2d910b1d tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:51.763839 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4f1d503b-24cb-4463-9dba-d1ba2d910b1d tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:51.764233 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4f1d503b-24cb-4463-9dba-d1ba2d910b1d tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:51.764926 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4f1d503b-24cb-4463-9dba-d1ba2d910b1d tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:51.765376 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4f1d503b-24cb-4463-9dba-d1ba2d910b1d tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:51.765829 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4f1d503b-24cb-4463-9dba-d1ba2d910b1d tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:51.785935 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-85742ce4-52cd-4544-aaa6-a064e1012aea tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:51.795160 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-85742ce4-52cd-4544-aaa6-a064e1012aea tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:51.797571 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-85742ce4-52cd-4544-aaa6-a064e1012aea tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:51.799742 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-85742ce4-52cd-4544-aaa6-a064e1012aea tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1407 microversion: 2.20 time: 0.204693 Oct 03 14:52:51.809819 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 82/155] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:51 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:52:51.904232 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-4f1d503b-24cb-4463-9dba-d1ba2d910b1d tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:51.914024 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-4f1d503b-24cb-4463-9dba-d1ba2d910b1d tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1321 microversion: 2.1 time: 0.162513 Oct 03 14:52:51.914601 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 74/156] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:51 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:52.005321 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-a69ff19e-3c87-4b82-ac22-7d5ce3688e32 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:52.005967 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-a69ff19e-3c87-4b82-ac22-7d5ce3688e32 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:52.012570 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a69ff19e-3c87-4b82-ac22-7d5ce3688e32 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:52.013117 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a69ff19e-3c87-4b82-ac22-7d5ce3688e32 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:52.013706 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a69ff19e-3c87-4b82-ac22-7d5ce3688e32 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:52.014454 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a69ff19e-3c87-4b82-ac22-7d5ce3688e32 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:52.014907 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a69ff19e-3c87-4b82-ac22-7d5ce3688e32 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:52.015413 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a69ff19e-3c87-4b82-ac22-7d5ce3688e32 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:52.091579 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-c5d76a6e-f530-449b-9c3f-47ea703d1dc6 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:52.092184 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-c5d76a6e-f530-449b-9c3f-47ea703d1dc6 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:52.099241 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c5d76a6e-f530-449b-9c3f-47ea703d1dc6 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:52.099780 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c5d76a6e-f530-449b-9c3f-47ea703d1dc6 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:52.100402 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c5d76a6e-f530-449b-9c3f-47ea703d1dc6 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:52.101241 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c5d76a6e-f530-449b-9c3f-47ea703d1dc6 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:52.101730 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c5d76a6e-f530-449b-9c3f-47ea703d1dc6 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:52.102157 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c5d76a6e-f530-449b-9c3f-47ea703d1dc6 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:52.148168 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-a69ff19e-3c87-4b82-ac22-7d5ce3688e32 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:52.157673 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-a69ff19e-3c87-4b82-ac22-7d5ce3688e32 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1358 microversion: 2.1 time: 0.156137 Oct 03 14:52:52.159558 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 83/157] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:52 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:52.237430 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-c5d76a6e-f530-449b-9c3f-47ea703d1dc6 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:52.245361 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-c5d76a6e-f530-449b-9c3f-47ea703d1dc6 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 200 len: 1368 microversion: 2.1 time: 0.157656 Oct 03 14:52:52.245949 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 75/158] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:52 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:52.717811 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-3d474a16-4ed6-470c-bed0-65c3b1847265 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:52.718864 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-3d474a16-4ed6-470c-bed0-65c3b1847265 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:52.725063 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3d474a16-4ed6-470c-bed0-65c3b1847265 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:52.725687 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3d474a16-4ed6-470c-bed0-65c3b1847265 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:52.726324 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3d474a16-4ed6-470c-bed0-65c3b1847265 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:52.727022 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3d474a16-4ed6-470c-bed0-65c3b1847265 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:52.727546 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3d474a16-4ed6-470c-bed0-65c3b1847265 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:52.727969 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3d474a16-4ed6-470c-bed0-65c3b1847265 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:52.749987 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=100 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:52.826354 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-049b0a5a-c143-4e26-b2b5-1e2a4c7a8043 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:52.826940 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-049b0a5a-c143-4e26-b2b5-1e2a4c7a8043 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:52.838576 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_api:SELECT=100 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:52.842776 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-049b0a5a-c143-4e26-b2b5-1e2a4c7a8043 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:52.843736 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-049b0a5a-c143-4e26-b2b5-1e2a4c7a8043 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:52.846242 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-049b0a5a-c143-4e26-b2b5-1e2a4c7a8043 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:52.847112 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-049b0a5a-c143-4e26-b2b5-1e2a4c7a8043 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:52.847691 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-049b0a5a-c143-4e26-b2b5-1e2a4c7a8043 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:52.848152 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-049b0a5a-c143-4e26-b2b5-1e2a4c7a8043 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:53.090062 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-049b0a5a-c143-4e26-b2b5-1e2a4c7a8043 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:53.104708 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-049b0a5a-c143-4e26-b2b5-1e2a4c7a8043 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:53.107699 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-049b0a5a-c143-4e26-b2b5-1e2a4c7a8043 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:53.113250 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-049b0a5a-c143-4e26-b2b5-1e2a4c7a8043 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1407 microversion: 2.20 time: 0.288177 Oct 03 14:52:53.114544 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 76/159] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:52 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1407 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:52:53.118446 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-3d474a16-4ed6-470c-bed0-65c3b1847265 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:53.139767 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-d621f49c-a859-4aee-83bc-209684bdec31 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:53.140277 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-3d474a16-4ed6-470c-bed0-65c3b1847265 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1314 microversion: 2.1 time: 0.426352 Oct 03 14:52:53.141179 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-d621f49c-a859-4aee-83bc-209684bdec31 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:53.142201 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 84/160] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:52 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:53.165158 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d621f49c-a859-4aee-83bc-209684bdec31 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:53.165746 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d621f49c-a859-4aee-83bc-209684bdec31 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:53.166588 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d621f49c-a859-4aee-83bc-209684bdec31 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:53.167420 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d621f49c-a859-4aee-83bc-209684bdec31 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:53.167984 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d621f49c-a859-4aee-83bc-209684bdec31 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:53.168695 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d621f49c-a859-4aee-83bc-209684bdec31 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:53.183479 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-1a55ca6d-b41b-4264-97b9-6273b6fdb04c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:53.184409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-1a55ca6d-b41b-4264-97b9-6273b6fdb04c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:53.193861 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1a55ca6d-b41b-4264-97b9-6273b6fdb04c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:53.194843 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1a55ca6d-b41b-4264-97b9-6273b6fdb04c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:53.196432 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1a55ca6d-b41b-4264-97b9-6273b6fdb04c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:53.197478 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1a55ca6d-b41b-4264-97b9-6273b6fdb04c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:53.198985 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1a55ca6d-b41b-4264-97b9-6273b6fdb04c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:53.202131 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1a55ca6d-b41b-4264-97b9-6273b6fdb04c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:53.365741 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-1a55ca6d-b41b-4264-97b9-6273b6fdb04c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:53.379561 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-1a55ca6d-b41b-4264-97b9-6273b6fdb04c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1358 microversion: 2.1 time: 0.200472 Oct 03 14:52:53.394709 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 85/161] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:53 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:53.394709 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-6e4f9e72-f9d8-480a-9137-64c5197813a3 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:53.394709 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-6e4f9e72-f9d8-480a-9137-64c5197813a3 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:53.394709 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6e4f9e72-f9d8-480a-9137-64c5197813a3 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:53.395603 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6e4f9e72-f9d8-480a-9137-64c5197813a3 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:53.395603 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6e4f9e72-f9d8-480a-9137-64c5197813a3 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:53.395603 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6e4f9e72-f9d8-480a-9137-64c5197813a3 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:53.395603 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6e4f9e72-f9d8-480a-9137-64c5197813a3 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:53.396416 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6e4f9e72-f9d8-480a-9137-64c5197813a3 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:53.443573 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-d621f49c-a859-4aee-83bc-209684bdec31 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:53.453838 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-d621f49c-a859-4aee-83bc-209684bdec31 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1321 microversion: 2.1 time: 0.337049 Oct 03 14:52:53.457869 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 77/162] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:53 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1321 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:53.560636 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-6e4f9e72-f9d8-480a-9137-64c5197813a3 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:53.568641 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-6e4f9e72-f9d8-480a-9137-64c5197813a3 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 200 len: 1368 microversion: 2.1 time: 0.187223 Oct 03 14:52:53.569291 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 86/163] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:53 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:53.639893 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-81ac2282-cb17-446c-887d-d196288b780c req-6bd6813f-d561-4dfc-97b4-efd3fcd6048e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bac89fd1-5f09-42a7-90f2-5074c12859fc", "tag": "8e144fc1-dc68-4200-84eb-87fed3d70fcb"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:53.652884 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-81ac2282-cb17-446c-887d-d196288b780c req-6bd6813f-d561-4dfc-97b4-efd3fcd6048e service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:53.653353 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-81ac2282-cb17-446c-887d-d196288b780c req-6bd6813f-d561-4dfc-97b4-efd3fcd6048e service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:53.654211 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-81ac2282-cb17-446c-887d-d196288b780c req-6bd6813f-d561-4dfc-97b4-efd3fcd6048e service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:53.667017 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-81ac2282-cb17-446c-887d-d196288b780c req-6bd6813f-d561-4dfc-97b4-efd3fcd6048e service nova] Creating event network-changed:8e144fc1-dc68-4200-84eb-87fed3d70fcb for instance bac89fd1-5f09-42a7-90f2-5074c12859fc on hv-cinder-85987 Oct 03 14:52:53.672265 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-81ac2282-cb17-446c-887d-d196288b780c req-6bd6813f-d561-4dfc-97b4-efd3fcd6048e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037042 Oct 03 14:52:53.672742 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 78/164] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:52:54.139412 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-cd91b7b7-9e76-4e88-a3fa-f0a95af85898 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:54.140350 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-cd91b7b7-9e76-4e88-a3fa-f0a95af85898 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:54.146356 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cd91b7b7-9e76-4e88-a3fa-f0a95af85898 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:54.146842 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cd91b7b7-9e76-4e88-a3fa-f0a95af85898 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:54.147277 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cd91b7b7-9e76-4e88-a3fa-f0a95af85898 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:54.148033 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cd91b7b7-9e76-4e88-a3fa-f0a95af85898 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:54.148492 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cd91b7b7-9e76-4e88-a3fa-f0a95af85898 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:54.148949 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cd91b7b7-9e76-4e88-a3fa-f0a95af85898 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:54.165215 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-78b2c258-a51b-4463-878f-31ec5e130a70 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:54.165968 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-78b2c258-a51b-4463-878f-31ec5e130a70 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:54.172154 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-78b2c258-a51b-4463-878f-31ec5e130a70 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:54.172641 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-78b2c258-a51b-4463-878f-31ec5e130a70 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:54.173071 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-78b2c258-a51b-4463-878f-31ec5e130a70 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:54.173801 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-78b2c258-a51b-4463-878f-31ec5e130a70 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:54.180401 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-78b2c258-a51b-4463-878f-31ec5e130a70 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:54.180659 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-78b2c258-a51b-4463-878f-31ec5e130a70 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:54.326700 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-cd91b7b7-9e76-4e88-a3fa-f0a95af85898 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:54.334972 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-cd91b7b7-9e76-4e88-a3fa-f0a95af85898 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:54.336412 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-cd91b7b7-9e76-4e88-a3fa-f0a95af85898 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:54.337546 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-cd91b7b7-9e76-4e88-a3fa-f0a95af85898 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1407 microversion: 2.20 time: 0.202250 Oct 03 14:52:54.338129 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 87/165] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:54 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:52:54.404721 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-04259a76-7562-4718-a6ec-48fa4edba511 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:54.405463 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-04259a76-7562-4718-a6ec-48fa4edba511 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:54.411345 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-04259a76-7562-4718-a6ec-48fa4edba511 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:54.411912 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-04259a76-7562-4718-a6ec-48fa4edba511 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:54.412421 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-04259a76-7562-4718-a6ec-48fa4edba511 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:54.413223 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-04259a76-7562-4718-a6ec-48fa4edba511 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:54.413716 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-04259a76-7562-4718-a6ec-48fa4edba511 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:54.414140 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-04259a76-7562-4718-a6ec-48fa4edba511 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:54.427466 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-78b2c258-a51b-4463-878f-31ec5e130a70 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:54.435580 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-78b2c258-a51b-4463-878f-31ec5e130a70 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1314 microversion: 2.1 time: 0.274861 Oct 03 14:52:54.436790 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 79/166] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:54 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:54.480158 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-8e475320-cfe7-4fc0-8534-ebe9efe619b4 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:54.484459 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-8e475320-cfe7-4fc0-8534-ebe9efe619b4 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:54.499924 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8e475320-cfe7-4fc0-8534-ebe9efe619b4 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:54.500425 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8e475320-cfe7-4fc0-8534-ebe9efe619b4 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:54.500861 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8e475320-cfe7-4fc0-8534-ebe9efe619b4 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:54.511139 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8e475320-cfe7-4fc0-8534-ebe9efe619b4 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:54.512197 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8e475320-cfe7-4fc0-8534-ebe9efe619b4 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:54.512654 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8e475320-cfe7-4fc0-8534-ebe9efe619b4 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:54.658154 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-04259a76-7562-4718-a6ec-48fa4edba511 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:54.680560 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-04259a76-7562-4718-a6ec-48fa4edba511 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1358 microversion: 2.1 time: 0.276190 Oct 03 14:52:54.681184 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 88/167] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:54 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1358 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:54.706035 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-27cc6097-f249-403c-998b-29ec18ecaf68 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:54.706656 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-27cc6097-f249-403c-998b-29ec18ecaf68 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:54.713276 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-27cc6097-f249-403c-998b-29ec18ecaf68 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:54.713799 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-27cc6097-f249-403c-998b-29ec18ecaf68 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:54.714236 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-27cc6097-f249-403c-998b-29ec18ecaf68 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:54.715117 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-27cc6097-f249-403c-998b-29ec18ecaf68 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:54.715575 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-27cc6097-f249-403c-998b-29ec18ecaf68 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:54.716000 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-27cc6097-f249-403c-998b-29ec18ecaf68 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:54.843487 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-8e475320-cfe7-4fc0-8534-ebe9efe619b4 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:54.857883 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-8e475320-cfe7-4fc0-8534-ebe9efe619b4 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1321 microversion: 2.1 time: 0.380805 Oct 03 14:52:54.858621 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 80/168] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:54 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1321 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:55.011487 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-27cc6097-f249-403c-998b-29ec18ecaf68 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:55.027676 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-27cc6097-f249-403c-998b-29ec18ecaf68 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 200 len: 1368 microversion: 2.1 time: 0.328984 Oct 03 14:52:55.027676 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 89/169] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:54 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 1368 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:55.127758 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-ab3cf9f1-6307-4a13-8e1a-94675e2923fd req-1d866af2-f599-436d-8472-67467514d1b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27879d6c-62f5-4281-b134-faecf706a2db", "name": "network-vif-plugged", "status": "completed", "tag": "abd33b94-cd03-47ad-bbbe-b38838da0555"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:55.145276 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-ab3cf9f1-6307-4a13-8e1a-94675e2923fd req-1d866af2-f599-436d-8472-67467514d1b6 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:55.150607 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-ab3cf9f1-6307-4a13-8e1a-94675e2923fd req-1d866af2-f599-436d-8472-67467514d1b6 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:55.151118 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-ab3cf9f1-6307-4a13-8e1a-94675e2923fd req-1d866af2-f599-436d-8472-67467514d1b6 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:55.176238 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-ab3cf9f1-6307-4a13-8e1a-94675e2923fd req-1d866af2-f599-436d-8472-67467514d1b6 service nova] Creating event network-vif-plugged:abd33b94-cd03-47ad-bbbe-b38838da0555 for instance 27879d6c-62f5-4281-b134-faecf706a2db on hv-cinder-85987 Oct 03 14:52:55.183171 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-ab3cf9f1-6307-4a13-8e1a-94675e2923fd req-1d866af2-f599-436d-8472-67467514d1b6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059644 Oct 03 14:52:55.183985 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 81/170] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:52:55.363728 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-e35b27e0-64be-4ed0-8904-5493e1a59075 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:55.364936 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-e35b27e0-64be-4ed0-8904-5493e1a59075 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:55.371704 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e35b27e0-64be-4ed0-8904-5493e1a59075 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:55.372597 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e35b27e0-64be-4ed0-8904-5493e1a59075 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:55.373031 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e35b27e0-64be-4ed0-8904-5493e1a59075 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:55.374139 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e35b27e0-64be-4ed0-8904-5493e1a59075 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:55.374603 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e35b27e0-64be-4ed0-8904-5493e1a59075 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:55.375064 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e35b27e0-64be-4ed0-8904-5493e1a59075 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:55.471871 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-97f2473a-b148-4e12-a813-6140cafd2e1a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:55.474153 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-97f2473a-b148-4e12-a813-6140cafd2e1a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:55.480646 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-97f2473a-b148-4e12-a813-6140cafd2e1a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:55.481886 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-97f2473a-b148-4e12-a813-6140cafd2e1a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:55.482328 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-97f2473a-b148-4e12-a813-6140cafd2e1a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:55.483218 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-97f2473a-b148-4e12-a813-6140cafd2e1a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:55.483824 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-97f2473a-b148-4e12-a813-6140cafd2e1a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:55.484529 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-97f2473a-b148-4e12-a813-6140cafd2e1a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:55.542158 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-e35b27e0-64be-4ed0-8904-5493e1a59075 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:55.550720 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-e35b27e0-64be-4ed0-8904-5493e1a59075 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:55.553637 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-e35b27e0-64be-4ed0-8904-5493e1a59075 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:55.555053 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-e35b27e0-64be-4ed0-8904-5493e1a59075 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1407 microversion: 2.20 time: 0.195750 Oct 03 14:52:55.556194 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 90/171] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:55 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:52:55.655969 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-97f2473a-b148-4e12-a813-6140cafd2e1a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:55.665047 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-97f2473a-b148-4e12-a813-6140cafd2e1a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1314 microversion: 2.1 time: 0.197938 Oct 03 14:52:55.665749 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 82/172] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:55 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:55.704447 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-c9db86cf-dca9-4379-a2ab-0fa31b866a8a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:55.705286 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-c9db86cf-dca9-4379-a2ab-0fa31b866a8a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:55.714478 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c9db86cf-dca9-4379-a2ab-0fa31b866a8a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:55.715120 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c9db86cf-dca9-4379-a2ab-0fa31b866a8a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:55.715850 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c9db86cf-dca9-4379-a2ab-0fa31b866a8a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:55.719475 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c9db86cf-dca9-4379-a2ab-0fa31b866a8a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:55.719945 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c9db86cf-dca9-4379-a2ab-0fa31b866a8a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:55.720377 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c9db86cf-dca9-4379-a2ab-0fa31b866a8a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:55.882396 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-7d993a54-bf9f-43d1-872e-52d0ccd53a66 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:55.883178 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-7d993a54-bf9f-43d1-872e-52d0ccd53a66 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:55.889616 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-c9db86cf-dca9-4379-a2ab-0fa31b866a8a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:55.891314 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7d993a54-bf9f-43d1-872e-52d0ccd53a66 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:55.891798 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7d993a54-bf9f-43d1-872e-52d0ccd53a66 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:55.892238 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7d993a54-bf9f-43d1-872e-52d0ccd53a66 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:55.893096 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7d993a54-bf9f-43d1-872e-52d0ccd53a66 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:55.893732 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7d993a54-bf9f-43d1-872e-52d0ccd53a66 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:55.894292 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7d993a54-bf9f-43d1-872e-52d0ccd53a66 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:55.905280 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-c9db86cf-dca9-4379-a2ab-0fa31b866a8a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1358 microversion: 2.1 time: 0.204876 Oct 03 14:52:55.906713 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 91/173] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:55 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:56.054158 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-af31175e-9d22-4255-89e3-b22793e740b3 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:56.054997 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-af31175e-9d22-4255-89e3-b22793e740b3 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:56.062083 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-af31175e-9d22-4255-89e3-b22793e740b3 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:56.062757 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-af31175e-9d22-4255-89e3-b22793e740b3 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:56.063219 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-af31175e-9d22-4255-89e3-b22793e740b3 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:56.064164 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-af31175e-9d22-4255-89e3-b22793e740b3 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:56.064750 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-af31175e-9d22-4255-89e3-b22793e740b3 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:56.065710 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-af31175e-9d22-4255-89e3-b22793e740b3 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:56.125924 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-7d993a54-bf9f-43d1-872e-52d0ccd53a66 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:56.136936 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-7d993a54-bf9f-43d1-872e-52d0ccd53a66 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1321 microversion: 2.1 time: 0.258096 Oct 03 14:52:56.138347 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 83/174] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:55 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:56.292515 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-af31175e-9d22-4255-89e3-b22793e740b3 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:56.314233 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-af31175e-9d22-4255-89e3-b22793e740b3 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 200 len: 1368 microversion: 2.1 time: 0.265384 Oct 03 14:52:56.331206 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 92/175] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:56 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 1368 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:56.581232 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-456ed8fc-ad32-467f-90f8-0cf450598cc7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:56.581863 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-456ed8fc-ad32-467f-90f8-0cf450598cc7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:56.588837 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-456ed8fc-ad32-467f-90f8-0cf450598cc7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:56.590967 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-456ed8fc-ad32-467f-90f8-0cf450598cc7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:56.591566 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-456ed8fc-ad32-467f-90f8-0cf450598cc7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:56.593002 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-456ed8fc-ad32-467f-90f8-0cf450598cc7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:56.594774 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-456ed8fc-ad32-467f-90f8-0cf450598cc7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:56.595210 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-456ed8fc-ad32-467f-90f8-0cf450598cc7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:56.689878 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-bd9ce344-b804-46b9-a12e-b7a5c5b4bf87 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:56.691290 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-bd9ce344-b804-46b9-a12e-b7a5c5b4bf87 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:56.699748 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bd9ce344-b804-46b9-a12e-b7a5c5b4bf87 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:56.700528 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bd9ce344-b804-46b9-a12e-b7a5c5b4bf87 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:56.701110 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bd9ce344-b804-46b9-a12e-b7a5c5b4bf87 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:56.702115 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bd9ce344-b804-46b9-a12e-b7a5c5b4bf87 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:56.702753 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bd9ce344-b804-46b9-a12e-b7a5c5b4bf87 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:56.703180 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bd9ce344-b804-46b9-a12e-b7a5c5b4bf87 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:56.773685 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-456ed8fc-ad32-467f-90f8-0cf450598cc7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:56.802563 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-456ed8fc-ad32-467f-90f8-0cf450598cc7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:56.804162 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-456ed8fc-ad32-467f-90f8-0cf450598cc7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:56.805849 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-456ed8fc-ad32-467f-90f8-0cf450598cc7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1407 microversion: 2.20 time: 0.228834 Oct 03 14:52:56.809633 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 84/176] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:56 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:52:56.883346 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-bd9ce344-b804-46b9-a12e-b7a5c5b4bf87 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:56.891447 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-bd9ce344-b804-46b9-a12e-b7a5c5b4bf87 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1314 microversion: 2.1 time: 0.206069 Oct 03 14:52:56.892144 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 93/177] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:56 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:56.928744 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-e9b504fe-ebe7-4d97-b9a6-cac83e0ceaec tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:56.929362 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-e9b504fe-ebe7-4d97-b9a6-cac83e0ceaec tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:56.937116 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e9b504fe-ebe7-4d97-b9a6-cac83e0ceaec tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:56.937961 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e9b504fe-ebe7-4d97-b9a6-cac83e0ceaec tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:56.938543 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e9b504fe-ebe7-4d97-b9a6-cac83e0ceaec tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:56.940007 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e9b504fe-ebe7-4d97-b9a6-cac83e0ceaec tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:56.940806 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e9b504fe-ebe7-4d97-b9a6-cac83e0ceaec tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:56.941463 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e9b504fe-ebe7-4d97-b9a6-cac83e0ceaec tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:57.149140 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-e9b504fe-ebe7-4d97-b9a6-cac83e0ceaec tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:57.153959 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=100 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:57.162094 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-bcab95bb-f8f7-47e6-9f82-26047f9740f6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:57.163131 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-bcab95bb-f8f7-47e6-9f82-26047f9740f6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:57.165634 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-e9b504fe-ebe7-4d97-b9a6-cac83e0ceaec tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1358 microversion: 2.1 time: 0.240250 Oct 03 14:52:57.166788 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 85/178] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:56 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:57.173012 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bcab95bb-f8f7-47e6-9f82-26047f9740f6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:57.173620 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bcab95bb-f8f7-47e6-9f82-26047f9740f6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:57.174781 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bcab95bb-f8f7-47e6-9f82-26047f9740f6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:57.175724 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bcab95bb-f8f7-47e6-9f82-26047f9740f6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:57.176181 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bcab95bb-f8f7-47e6-9f82-26047f9740f6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:57.176761 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bcab95bb-f8f7-47e6-9f82-26047f9740f6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:57.200261 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-603c47a1-1f99-48e1-be0f-0ff4445773b5 req-4afc4427-8765-4d25-9f26-42961ee7a58b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "193f7fe8-5737-49b3-a165-4345f3357042", "name": "network-vif-plugged", "status": "completed", "tag": "06e443b0-42ce-487b-9e0c-244828a5e40e"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:57.219160 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-603c47a1-1f99-48e1-be0f-0ff4445773b5 req-4afc4427-8765-4d25-9f26-42961ee7a58b service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:57.221013 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-603c47a1-1f99-48e1-be0f-0ff4445773b5 req-4afc4427-8765-4d25-9f26-42961ee7a58b service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:57.221482 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-603c47a1-1f99-48e1-be0f-0ff4445773b5 req-4afc4427-8765-4d25-9f26-42961ee7a58b service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:57.238412 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-603c47a1-1f99-48e1-be0f-0ff4445773b5 req-4afc4427-8765-4d25-9f26-42961ee7a58b service nova] Creating event network-vif-plugged:06e443b0-42ce-487b-9e0c-244828a5e40e for instance 193f7fe8-5737-49b3-a165-4345f3357042 on hv-cinder-85987 Oct 03 14:52:57.250072 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-603c47a1-1f99-48e1-be0f-0ff4445773b5 req-4afc4427-8765-4d25-9f26-42961ee7a58b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051558 Oct 03 14:52:57.251382 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 86/179] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:52:57.343817 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-5a81b58d-6563-49f2-b836-55b0c003dd69 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:57.344449 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-5a81b58d-6563-49f2-b836-55b0c003dd69 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:57.356097 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5a81b58d-6563-49f2-b836-55b0c003dd69 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:57.356593 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5a81b58d-6563-49f2-b836-55b0c003dd69 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:57.357033 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5a81b58d-6563-49f2-b836-55b0c003dd69 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:57.357764 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5a81b58d-6563-49f2-b836-55b0c003dd69 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:57.358392 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5a81b58d-6563-49f2-b836-55b0c003dd69 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:57.358971 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5a81b58d-6563-49f2-b836-55b0c003dd69 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:57.498317 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-bcab95bb-f8f7-47e6-9f82-26047f9740f6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:57.512250 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-bcab95bb-f8f7-47e6-9f82-26047f9740f6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1321 microversion: 2.1 time: 0.354861 Oct 03 14:52:57.513564 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 94/180] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:57 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1321 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:57.647289 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-5a81b58d-6563-49f2-b836-55b0c003dd69 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:57.655046 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-5a81b58d-6563-49f2-b836-55b0c003dd69 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 200 len: 1368 microversion: 2.1 time: 0.320480 Oct 03 14:52:57.655625 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 87/181] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:57 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 1368 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:57.836573 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-073dc9b2-f239-4c03-9d36-8bed6fcc94af tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:57.838083 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-073dc9b2-f239-4c03-9d36-8bed6fcc94af tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:57.847004 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-073dc9b2-f239-4c03-9d36-8bed6fcc94af tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:57.848036 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-073dc9b2-f239-4c03-9d36-8bed6fcc94af tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:57.848790 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-073dc9b2-f239-4c03-9d36-8bed6fcc94af tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:57.849830 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-073dc9b2-f239-4c03-9d36-8bed6fcc94af tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:57.850590 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-073dc9b2-f239-4c03-9d36-8bed6fcc94af tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:57.851214 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-073dc9b2-f239-4c03-9d36-8bed6fcc94af tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:57.873254 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-f0187611-5def-4d84-9af0-68ccad3f359f tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1389565529", "imageRef": "add7a872-2ca1-4366-9a93-f0663fdb297b", "flavorRef": "452"}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:57.956039 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.network.neutron [None req-f0187611-5def-4d84-9af0-68ccad3f359f tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] validate_networks() for None {{(pid=126852) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:52:58.059870 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-073dc9b2-f239-4c03-9d36-8bed6fcc94af tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:58.070981 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-073dc9b2-f239-4c03-9d36-8bed6fcc94af tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:58.072439 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-073dc9b2-f239-4c03-9d36-8bed6fcc94af tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:58.074063 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-073dc9b2-f239-4c03-9d36-8bed6fcc94af tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1407 microversion: 2.20 time: 0.242249 Oct 03 14:52:58.075354 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 95/182] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:57 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:52:58.096113 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-8adcc636-b0fb-4f5e-a38a-1c2494b1925a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:58.096728 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-8adcc636-b0fb-4f5e-a38a-1c2494b1925a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:58.104404 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8adcc636-b0fb-4f5e-a38a-1c2494b1925a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:58.105411 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8adcc636-b0fb-4f5e-a38a-1c2494b1925a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:58.106501 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8adcc636-b0fb-4f5e-a38a-1c2494b1925a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:58.107475 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8adcc636-b0fb-4f5e-a38a-1c2494b1925a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:58.108249 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8adcc636-b0fb-4f5e-a38a-1c2494b1925a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:58.109250 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8adcc636-b0fb-4f5e-a38a-1c2494b1925a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:58.269200 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-8adcc636-b0fb-4f5e-a38a-1c2494b1925a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:58.301109 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-8adcc636-b0fb-4f5e-a38a-1c2494b1925a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1314 microversion: 2.1 time: 0.222530 Oct 03 14:52:58.310828 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 96/183] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:58 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:58.317474 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-75a73e62-6272-4d43-8a89-0a451396efbe tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:58.318174 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-75a73e62-6272-4d43-8a89-0a451396efbe tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:58.328633 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-75a73e62-6272-4d43-8a89-0a451396efbe tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:58.329135 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-75a73e62-6272-4d43-8a89-0a451396efbe tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:58.329597 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-75a73e62-6272-4d43-8a89-0a451396efbe tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:58.330356 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-75a73e62-6272-4d43-8a89-0a451396efbe tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:58.330824 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-75a73e62-6272-4d43-8a89-0a451396efbe tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:58.331790 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-75a73e62-6272-4d43-8a89-0a451396efbe tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:58.478583 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-f0187611-5def-4d84-9af0-68ccad3f359f tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Flavor limits 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:52:58.479135 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-f0187611-5def-4d84-9af0-68ccad3f359f tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Image limits 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:52:58.479667 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-f0187611-5def-4d84-9af0-68ccad3f359f tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Flavor pref 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:52:58.480170 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-f0187611-5def-4d84-9af0-68ccad3f359f tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Image pref 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:52:58.480661 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-f0187611-5def-4d84-9af0-68ccad3f359f tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:52:58.488477 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-75a73e62-6272-4d43-8a89-0a451396efbe tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:58.492409 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f0187611-5def-4d84-9af0-68ccad3f359f tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:58.493115 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f0187611-5def-4d84-9af0-68ccad3f359f tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:58.493768 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f0187611-5def-4d84-9af0-68ccad3f359f tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:58.494718 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f0187611-5def-4d84-9af0-68ccad3f359f tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:58.495370 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f0187611-5def-4d84-9af0-68ccad3f359f tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:58.495968 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f0187611-5def-4d84-9af0-68ccad3f359f tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:58.497460 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-75a73e62-6272-4d43-8a89-0a451396efbe tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1358 microversion: 2.1 time: 0.185257 Oct 03 14:52:58.498948 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 97/184] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:58 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:58.525008 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-f0187611-5def-4d84-9af0-68ccad3f359f tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Getting quotas for project 2a3f1ef0d0c343dfbf2eae49c0ea450c. Resources: {'ram', 'instances', 'cores'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:52:58.529226 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-f0187611-5def-4d84-9af0-68ccad3f359f tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Getting quotas for user fc880a31f5be4ea2a500bfa504749ce0 and project 2a3f1ef0d0c343dfbf2eae49c0ea450c. Resources: {'ram', 'instances', 'cores'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:52:58.539076 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-5008269b-a068-41a4-9704-04c90ec1b7c9 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:58.539885 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-5008269b-a068-41a4-9704-04c90ec1b7c9 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:58.549576 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5008269b-a068-41a4-9704-04c90ec1b7c9 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:58.551085 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5008269b-a068-41a4-9704-04c90ec1b7c9 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:58.556581 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-f0187611-5def-4d84-9af0-68ccad3f359f tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Going to run 1 instances... {{(pid=126852) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:52:58.559274 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-f0187611-5def-4d84-9af0-68ccad3f359f tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='add7a872-2ca1-4366-9a93-f0663fdb297b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:52:58.567367 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5008269b-a068-41a4-9704-04c90ec1b7c9 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:58.568117 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5008269b-a068-41a4-9704-04c90ec1b7c9 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:58.569964 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5008269b-a068-41a4-9704-04c90ec1b7c9 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:58.570570 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5008269b-a068-41a4-9704-04c90ec1b7c9 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:58.610666 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-f0187611-5def-4d84-9af0-68ccad3f359f tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.742129 Oct 03 14:52:58.612845 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 88/185] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 3 14:52:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:52:58.624074 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-b450ace3-8c22-4457-9a3a-d0ad5774c054 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:58.624677 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-b450ace3-8c22-4457-9a3a-d0ad5774c054 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:58.759326 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-b450ace3-8c22-4457-9a3a-d0ad5774c054 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc880a31f5be4ea2a500bfa504749ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3f1ef0d0c343dfbf2eae49c0ea450c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:58.768759 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-b450ace3-8c22-4457-9a3a-d0ad5774c054 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777" status: 200 len: 1215 microversion: 2.1 time: 0.148040 Oct 03 14:52:58.770912 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 89/186] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:58 2022] GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 => generated 1215 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:58.776886 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-c872dc87-bff9-4916-817b-895ca9d7de1c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:58.777517 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-c872dc87-bff9-4916-817b-895ca9d7de1c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:58.808207 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c872dc87-bff9-4916-817b-895ca9d7de1c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:58.808995 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c872dc87-bff9-4916-817b-895ca9d7de1c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:58.809603 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c872dc87-bff9-4916-817b-895ca9d7de1c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:58.810760 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c872dc87-bff9-4916-817b-895ca9d7de1c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:58.811560 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c872dc87-bff9-4916-817b-895ca9d7de1c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:58.812193 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c872dc87-bff9-4916-817b-895ca9d7de1c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:58.835692 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-5008269b-a068-41a4-9704-04c90ec1b7c9 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:58.844660 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-5008269b-a068-41a4-9704-04c90ec1b7c9 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1321 microversion: 2.1 time: 0.309126 Oct 03 14:52:58.849666 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 98/187] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:58 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1321 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:59.018401 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-c872dc87-bff9-4916-817b-895ca9d7de1c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:59.028590 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-c872dc87-bff9-4916-817b-895ca9d7de1c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 200 len: 1368 microversion: 2.1 time: 0.256116 Oct 03 14:52:59.029395 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 90/188] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:58 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 1368 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:59.101566 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-fb7134a8-219f-4c16-bdcc-67bb98852cb3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:59.102288 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-fb7134a8-219f-4c16-bdcc-67bb98852cb3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:59.115176 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fb7134a8-219f-4c16-bdcc-67bb98852cb3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:59.116688 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fb7134a8-219f-4c16-bdcc-67bb98852cb3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:59.117919 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fb7134a8-219f-4c16-bdcc-67bb98852cb3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:59.120185 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fb7134a8-219f-4c16-bdcc-67bb98852cb3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:59.122197 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fb7134a8-219f-4c16-bdcc-67bb98852cb3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:59.124077 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fb7134a8-219f-4c16-bdcc-67bb98852cb3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:59.320741 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-fb7134a8-219f-4c16-bdcc-67bb98852cb3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:59.324614 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-ea63c69f-a930-4cd3-8db3-3916945cf01a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:59.325229 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-ea63c69f-a930-4cd3-8db3-3916945cf01a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:59.333525 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-fb7134a8-219f-4c16-bdcc-67bb98852cb3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:59.335537 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-fb7134a8-219f-4c16-bdcc-67bb98852cb3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:59.336855 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-fb7134a8-219f-4c16-bdcc-67bb98852cb3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1407 microversion: 2.20 time: 0.241636 Oct 03 14:52:59.337994 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 99/189] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:59 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:52:59.358868 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ea63c69f-a930-4cd3-8db3-3916945cf01a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:59.359640 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ea63c69f-a930-4cd3-8db3-3916945cf01a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:59.360455 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ea63c69f-a930-4cd3-8db3-3916945cf01a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:59.364586 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ea63c69f-a930-4cd3-8db3-3916945cf01a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:59.367217 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ea63c69f-a930-4cd3-8db3-3916945cf01a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:59.368111 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ea63c69f-a930-4cd3-8db3-3916945cf01a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:59.520372 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-14d8c5a2-afa4-43c1-9387-2eba8d607b25 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:59.520977 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-14d8c5a2-afa4-43c1-9387-2eba8d607b25 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:59.528996 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-14d8c5a2-afa4-43c1-9387-2eba8d607b25 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:59.529777 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-14d8c5a2-afa4-43c1-9387-2eba8d607b25 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:59.530388 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-14d8c5a2-afa4-43c1-9387-2eba8d607b25 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:59.531399 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-14d8c5a2-afa4-43c1-9387-2eba8d607b25 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:59.532148 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-14d8c5a2-afa4-43c1-9387-2eba8d607b25 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:59.532778 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-14d8c5a2-afa4-43c1-9387-2eba8d607b25 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:59.547216 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-ea63c69f-a930-4cd3-8db3-3916945cf01a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:59.559230 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-ea63c69f-a930-4cd3-8db3-3916945cf01a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1314 microversion: 2.1 time: 0.238361 Oct 03 14:52:59.560260 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 91/190] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:59 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:59.750168 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-14d8c5a2-afa4-43c1-9387-2eba8d607b25 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:59.762775 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-14d8c5a2-afa4-43c1-9387-2eba8d607b25 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1358 microversion: 2.1 time: 0.245883 Oct 03 14:52:59.763355 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 100/191] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:59 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1358 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:59.791946 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-759e60bc-1764-47de-b68c-2c1e0b1a58b7 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:59.792541 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-759e60bc-1764-47de-b68c-2c1e0b1a58b7 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:59.798376 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-759e60bc-1764-47de-b68c-2c1e0b1a58b7 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:59.799519 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-759e60bc-1764-47de-b68c-2c1e0b1a58b7 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:59.799955 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-759e60bc-1764-47de-b68c-2c1e0b1a58b7 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:59.800662 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-759e60bc-1764-47de-b68c-2c1e0b1a58b7 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:59.801102 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-759e60bc-1764-47de-b68c-2c1e0b1a58b7 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:59.801544 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-759e60bc-1764-47de-b68c-2c1e0b1a58b7 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:59.863315 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-759e60bc-1764-47de-b68c-2c1e0b1a58b7 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc880a31f5be4ea2a500bfa504749ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3f1ef0d0c343dfbf2eae49c0ea450c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:59.871475 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-759e60bc-1764-47de-b68c-2c1e0b1a58b7 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777" status: 200 len: 1219 microversion: 2.1 time: 0.083289 Oct 03 14:52:59.872297 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 92/192] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:59 2022] GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:59.874146 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-fea891d3-3303-4c2b-962f-f6b0d4205d65 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:59.875306 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-fea891d3-3303-4c2b-962f-f6b0d4205d65 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:59.881206 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fea891d3-3303-4c2b-962f-f6b0d4205d65 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:59.881801 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fea891d3-3303-4c2b-962f-f6b0d4205d65 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:59.882327 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fea891d3-3303-4c2b-962f-f6b0d4205d65 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:59.883131 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fea891d3-3303-4c2b-962f-f6b0d4205d65 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:59.883731 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fea891d3-3303-4c2b-962f-f6b0d4205d65 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:59.884172 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fea891d3-3303-4c2b-962f-f6b0d4205d65 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:59.888346 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=100 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:00.015035 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-fea891d3-3303-4c2b-962f-f6b0d4205d65 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:00.022987 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-fea891d3-3303-4c2b-962f-f6b0d4205d65 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1321 microversion: 2.1 time: 0.153054 Oct 03 14:53:00.023579 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 101/193] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:59 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:00.052975 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-5d7a4d5b-7301-42b1-b115-31a82e1b7855 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:00.057748 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-5d7a4d5b-7301-42b1-b115-31a82e1b7855 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:00.063856 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5d7a4d5b-7301-42b1-b115-31a82e1b7855 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:00.064892 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5d7a4d5b-7301-42b1-b115-31a82e1b7855 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:00.065414 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5d7a4d5b-7301-42b1-b115-31a82e1b7855 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:00.066100 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5d7a4d5b-7301-42b1-b115-31a82e1b7855 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:00.066680 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5d7a4d5b-7301-42b1-b115-31a82e1b7855 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:00.067134 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5d7a4d5b-7301-42b1-b115-31a82e1b7855 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:00.195992 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-5d7a4d5b-7301-42b1-b115-31a82e1b7855 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:00.203715 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-5d7a4d5b-7301-42b1-b115-31a82e1b7855 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 200 len: 1368 microversion: 2.1 time: 0.155199 Oct 03 14:53:00.204230 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 93/194] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:00 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:00.367101 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-810f58e5-1108-41fc-aed1-46efd1d54828 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:00.367705 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-810f58e5-1108-41fc-aed1-46efd1d54828 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:00.373682 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-810f58e5-1108-41fc-aed1-46efd1d54828 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:00.374157 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-810f58e5-1108-41fc-aed1-46efd1d54828 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:00.374588 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-810f58e5-1108-41fc-aed1-46efd1d54828 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:00.375265 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-810f58e5-1108-41fc-aed1-46efd1d54828 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:00.375718 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-810f58e5-1108-41fc-aed1-46efd1d54828 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:00.376135 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-810f58e5-1108-41fc-aed1-46efd1d54828 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:00.523129 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-810f58e5-1108-41fc-aed1-46efd1d54828 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:00.531272 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-810f58e5-1108-41fc-aed1-46efd1d54828 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:00.532706 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-810f58e5-1108-41fc-aed1-46efd1d54828 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:00.533885 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-810f58e5-1108-41fc-aed1-46efd1d54828 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1407 microversion: 2.20 time: 0.170646 Oct 03 14:53:00.534470 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 102/195] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:00 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:00.585875 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-3972f9df-4055-4fa4-b041-3437ab73eea7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:00.586505 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-3972f9df-4055-4fa4-b041-3437ab73eea7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:00.592275 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3972f9df-4055-4fa4-b041-3437ab73eea7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:00.593005 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3972f9df-4055-4fa4-b041-3437ab73eea7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:00.593431 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3972f9df-4055-4fa4-b041-3437ab73eea7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:00.594127 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3972f9df-4055-4fa4-b041-3437ab73eea7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:00.594572 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3972f9df-4055-4fa4-b041-3437ab73eea7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:00.594991 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3972f9df-4055-4fa4-b041-3437ab73eea7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:00.723824 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-3972f9df-4055-4fa4-b041-3437ab73eea7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:00.731451 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-3972f9df-4055-4fa4-b041-3437ab73eea7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1500 microversion: 2.1 time: 0.149445 Oct 03 14:53:00.731998 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 94/196] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:00 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1500 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:00.785670 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-d4a63d42-ccd8-40d8-916b-4b590ad6af09 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:00.786283 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-d4a63d42-ccd8-40d8-916b-4b590ad6af09 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:00.792314 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d4a63d42-ccd8-40d8-916b-4b590ad6af09 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:00.792800 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d4a63d42-ccd8-40d8-916b-4b590ad6af09 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:00.793231 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d4a63d42-ccd8-40d8-916b-4b590ad6af09 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:00.793946 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d4a63d42-ccd8-40d8-916b-4b590ad6af09 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:00.794396 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d4a63d42-ccd8-40d8-916b-4b590ad6af09 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:00.795017 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d4a63d42-ccd8-40d8-916b-4b590ad6af09 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:00.899533 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-ceb86846-0de6-459f-8409-ec7f2aa3f9bf tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:00.904409 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-ceb86846-0de6-459f-8409-ec7f2aa3f9bf tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:00.918740 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ceb86846-0de6-459f-8409-ec7f2aa3f9bf tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:00.920978 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ceb86846-0de6-459f-8409-ec7f2aa3f9bf tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:00.921760 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ceb86846-0de6-459f-8409-ec7f2aa3f9bf tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:00.923222 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ceb86846-0de6-459f-8409-ec7f2aa3f9bf tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:00.926091 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ceb86846-0de6-459f-8409-ec7f2aa3f9bf tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:00.926755 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ceb86846-0de6-459f-8409-ec7f2aa3f9bf tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:00.984045 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-d4a63d42-ccd8-40d8-916b-4b590ad6af09 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:00.997971 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-d4a63d42-ccd8-40d8-916b-4b590ad6af09 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1358 microversion: 2.1 time: 0.216141 Oct 03 14:53:00.999372 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 103/197] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:00 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:01.039523 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-ceb86846-0de6-459f-8409-ec7f2aa3f9bf tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc880a31f5be4ea2a500bfa504749ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3f1ef0d0c343dfbf2eae49c0ea450c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:01.049161 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-ceb86846-0de6-459f-8409-ec7f2aa3f9bf tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777" status: 200 len: 1219 microversion: 2.1 time: 0.156948 Oct 03 14:53:01.050163 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 95/198] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:00 2022] GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 => generated 1219 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:01.055082 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-1db91283-3672-4450-ab8e-b7bc0d815aa5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:01.055699 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-1db91283-3672-4450-ab8e-b7bc0d815aa5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:01.068731 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1db91283-3672-4450-ab8e-b7bc0d815aa5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:01.069868 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1db91283-3672-4450-ab8e-b7bc0d815aa5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:01.070422 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1db91283-3672-4450-ab8e-b7bc0d815aa5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:01.071470 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1db91283-3672-4450-ab8e-b7bc0d815aa5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:01.071997 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1db91283-3672-4450-ab8e-b7bc0d815aa5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:01.072492 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1db91283-3672-4450-ab8e-b7bc0d815aa5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:01.228949 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-e6651bea-7ec4-4ab3-b3e3-1587e7e15bc7 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:01.229723 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-e6651bea-7ec4-4ab3-b3e3-1587e7e15bc7 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:01.237951 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e6651bea-7ec4-4ab3-b3e3-1587e7e15bc7 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:01.238681 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e6651bea-7ec4-4ab3-b3e3-1587e7e15bc7 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:01.239337 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e6651bea-7ec4-4ab3-b3e3-1587e7e15bc7 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:01.241172 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e6651bea-7ec4-4ab3-b3e3-1587e7e15bc7 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:01.241842 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e6651bea-7ec4-4ab3-b3e3-1587e7e15bc7 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:01.242612 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e6651bea-7ec4-4ab3-b3e3-1587e7e15bc7 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:01.244789 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-1db91283-3672-4450-ab8e-b7bc0d815aa5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:01.256488 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-1db91283-3672-4450-ab8e-b7bc0d815aa5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1321 microversion: 2.1 time: 0.213876 Oct 03 14:53:01.261984 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 104/199] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:01 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:01.269439 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-c3e140bc-1c67-43a4-a3e9-df59529a6d65 req-80196bcb-b1e0-4d75-959e-8c23c34c1ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93eb4038-8732-40ab-b4ff-b9ba16dab3f3", "name": "network-vif-plugged", "status": "completed", "tag": "d7ceaf30-9e00-432b-b831-684569089003"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:53:01.282549 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-c3e140bc-1c67-43a4-a3e9-df59529a6d65 req-80196bcb-b1e0-4d75-959e-8c23c34c1ad0 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:01.284217 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-c3e140bc-1c67-43a4-a3e9-df59529a6d65 req-80196bcb-b1e0-4d75-959e-8c23c34c1ad0 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:01.285804 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-c3e140bc-1c67-43a4-a3e9-df59529a6d65 req-80196bcb-b1e0-4d75-959e-8c23c34c1ad0 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:01.303227 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-c3e140bc-1c67-43a4-a3e9-df59529a6d65 req-80196bcb-b1e0-4d75-959e-8c23c34c1ad0 service nova] Creating event network-vif-plugged:d7ceaf30-9e00-432b-b831-684569089003 for instance 93eb4038-8732-40ab-b4ff-b9ba16dab3f3 on hv-cinder-85987 Oct 03 14:53:01.308707 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-c3e140bc-1c67-43a4-a3e9-df59529a6d65 req-80196bcb-b1e0-4d75-959e-8c23c34c1ad0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045021 Oct 03 14:53:01.309311 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 105/200] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:53:01.411433 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-e6651bea-7ec4-4ab3-b3e3-1587e7e15bc7 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:01.419159 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-e6651bea-7ec4-4ab3-b3e3-1587e7e15bc7 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 200 len: 1558 microversion: 2.1 time: 0.195567 Oct 03 14:53:01.419723 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 96/201] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:01 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 1558 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:01.444655 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-fb7917eb-980a-43ac-965a-2daef6f9e95e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:01.445214 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-fb7917eb-980a-43ac-965a-2daef6f9e95e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:01.451895 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fb7917eb-980a-43ac-965a-2daef6f9e95e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:01.452492 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fb7917eb-980a-43ac-965a-2daef6f9e95e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:01.452987 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fb7917eb-980a-43ac-965a-2daef6f9e95e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:01.453709 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fb7917eb-980a-43ac-965a-2daef6f9e95e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:01.454163 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fb7917eb-980a-43ac-965a-2daef6f9e95e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:01.454584 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fb7917eb-980a-43ac-965a-2daef6f9e95e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:01.559596 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-cfdfedf7-58cf-46f0-aa81-69590cb543f1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:01.559596 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-cfdfedf7-58cf-46f0-aa81-69590cb543f1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:01.567655 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cfdfedf7-58cf-46f0-aa81-69590cb543f1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:01.567910 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cfdfedf7-58cf-46f0-aa81-69590cb543f1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:01.568314 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cfdfedf7-58cf-46f0-aa81-69590cb543f1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:01.569011 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cfdfedf7-58cf-46f0-aa81-69590cb543f1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:01.569478 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cfdfedf7-58cf-46f0-aa81-69590cb543f1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:01.569933 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cfdfedf7-58cf-46f0-aa81-69590cb543f1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:01.584220 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-fb7917eb-980a-43ac-965a-2daef6f9e95e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.143809 Oct 03 14:53:01.585242 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 106/202] 10.222.0.46 () {58 vars in 1275 bytes} [Mon Oct 3 14:53:01 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:53:01.889255 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-cfdfedf7-58cf-46f0-aa81-69590cb543f1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:01.897809 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-cfdfedf7-58cf-46f0-aa81-69590cb543f1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:01.899288 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-cfdfedf7-58cf-46f0-aa81-69590cb543f1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:01.900392 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-cfdfedf7-58cf-46f0-aa81-69590cb543f1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1407 microversion: 2.20 time: 0.345542 Oct 03 14:53:01.913518 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 97/203] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:01 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1407 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:02.022356 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-5fae2fe9-5907-4e48-ab34-cbc2a0bd627d tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:02.023132 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-5fae2fe9-5907-4e48-ab34-cbc2a0bd627d tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:02.029109 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5fae2fe9-5907-4e48-ab34-cbc2a0bd627d tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:02.029625 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5fae2fe9-5907-4e48-ab34-cbc2a0bd627d tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:02.030066 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5fae2fe9-5907-4e48-ab34-cbc2a0bd627d tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:02.030759 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5fae2fe9-5907-4e48-ab34-cbc2a0bd627d tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:02.031211 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5fae2fe9-5907-4e48-ab34-cbc2a0bd627d tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:02.031636 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5fae2fe9-5907-4e48-ab34-cbc2a0bd627d tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:02.074375 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-60fcfc77-ada7-41e2-8210-41aa86da8f9d tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:02.075061 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-60fcfc77-ada7-41e2-8210-41aa86da8f9d tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:02.082909 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-60fcfc77-ada7-41e2-8210-41aa86da8f9d tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:02.083639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-60fcfc77-ada7-41e2-8210-41aa86da8f9d tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:02.084321 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-60fcfc77-ada7-41e2-8210-41aa86da8f9d tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:02.085280 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-60fcfc77-ada7-41e2-8210-41aa86da8f9d tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:02.086094 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-60fcfc77-ada7-41e2-8210-41aa86da8f9d tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:02.086708 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-60fcfc77-ada7-41e2-8210-41aa86da8f9d tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:02.188084 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-5fae2fe9-5907-4e48-ab34-cbc2a0bd627d tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:02.198461 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-5fae2fe9-5907-4e48-ab34-cbc2a0bd627d tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1358 microversion: 2.1 time: 0.179782 Oct 03 14:53:02.210849 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 107/204] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:02 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:02.244958 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-60fcfc77-ada7-41e2-8210-41aa86da8f9d tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc880a31f5be4ea2a500bfa504749ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3f1ef0d0c343dfbf2eae49c0ea450c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:02.262604 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-60fcfc77-ada7-41e2-8210-41aa86da8f9d tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777" status: 200 len: 1219 microversion: 2.1 time: 0.190984 Oct 03 14:53:02.263229 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 98/205] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:02 2022] GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 => generated 1219 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:02.302596 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-4a84f9a3-2451-4e0c-b390-58454b7dda90 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:02.303205 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-4a84f9a3-2451-4e0c-b390-58454b7dda90 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:02.304153 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-1e301d9e-aa31-47cf-b062-759b5a0e1ce4 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6f5a738-e5bc-44d1-98cd-2f276db45b6f"}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:53:02.306902 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-1e301d9e-aa31-47cf-b062-759b5a0e1ce4 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:02.309517 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4a84f9a3-2451-4e0c-b390-58454b7dda90 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:02.310451 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4a84f9a3-2451-4e0c-b390-58454b7dda90 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:02.310901 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4a84f9a3-2451-4e0c-b390-58454b7dda90 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:02.311947 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4a84f9a3-2451-4e0c-b390-58454b7dda90 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:02.312591 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4a84f9a3-2451-4e0c-b390-58454b7dda90 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:02.313004 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4a84f9a3-2451-4e0c-b390-58454b7dda90 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:02.317734 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1e301d9e-aa31-47cf-b062-759b5a0e1ce4 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:02.318649 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1e301d9e-aa31-47cf-b062-759b5a0e1ce4 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:02.319083 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1e301d9e-aa31-47cf-b062-759b5a0e1ce4 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:02.319794 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1e301d9e-aa31-47cf-b062-759b5a0e1ce4 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:02.320310 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1e301d9e-aa31-47cf-b062-759b5a0e1ce4 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:02.320739 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1e301d9e-aa31-47cf-b062-759b5a0e1ce4 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:02.541371 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-4a84f9a3-2451-4e0c-b390-58454b7dda90 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:02.550629 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-4a84f9a3-2451-4e0c-b390-58454b7dda90 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1321 microversion: 2.1 time: 0.271416 Oct 03 14:53:02.565907 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 108/206] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:02 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1321 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:02.930420 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-23d5720e-e844-46e0-b8b2-c2fba4e3d615 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:02.931605 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-23d5720e-e844-46e0-b8b2-c2fba4e3d615 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:02.939363 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-23d5720e-e844-46e0-b8b2-c2fba4e3d615 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:02.940057 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-23d5720e-e844-46e0-b8b2-c2fba4e3d615 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:02.940667 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-23d5720e-e844-46e0-b8b2-c2fba4e3d615 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:02.941629 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-23d5720e-e844-46e0-b8b2-c2fba4e3d615 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:02.942084 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-23d5720e-e844-46e0-b8b2-c2fba4e3d615 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:02.942687 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-23d5720e-e844-46e0-b8b2-c2fba4e3d615 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:03.088299 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-23d5720e-e844-46e0-b8b2-c2fba4e3d615 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:03.097801 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-23d5720e-e844-46e0-b8b2-c2fba4e3d615 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:03.100176 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-23d5720e-e844-46e0-b8b2-c2fba4e3d615 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:03.101453 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-23d5720e-e844-46e0-b8b2-c2fba4e3d615 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1599 microversion: 2.20 time: 0.179349 Oct 03 14:53:03.105551 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 109/207] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:02 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1599 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:53:03.128432 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-7f532a5f-7130-4ea6-8696-40b9e34bd4fe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:03.128832 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-7f532a5f-7130-4ea6-8696-40b9e34bd4fe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:03.134735 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7f532a5f-7130-4ea6-8696-40b9e34bd4fe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:03.135217 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7f532a5f-7130-4ea6-8696-40b9e34bd4fe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:03.135859 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7f532a5f-7130-4ea6-8696-40b9e34bd4fe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:03.136549 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7f532a5f-7130-4ea6-8696-40b9e34bd4fe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:03.137002 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7f532a5f-7130-4ea6-8696-40b9e34bd4fe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:03.137417 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7f532a5f-7130-4ea6-8696-40b9e34bd4fe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:03.225171 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-7f532a5f-7130-4ea6-8696-40b9e34bd4fe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.101103 Oct 03 14:53:03.225968 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 110/208] 10.222.0.46 () {60 vars in 1316 bytes} [Mon Oct 3 14:53:03 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 14:53:03.232186 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-5910190d-97a4-419b-89bf-cac34fa34e32 req-3a57b260-c893-4eee-ba38-412997e80b59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e89e5bd3-ef0d-4314-b688-10af4dbf02a8", "tag": "9bdcc1e0-93a1-4a48-839a-e6c7d4339e25"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:53:03.259898 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-5910190d-97a4-419b-89bf-cac34fa34e32 req-3a57b260-c893-4eee-ba38-412997e80b59 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:03.260552 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-5910190d-97a4-419b-89bf-cac34fa34e32 req-3a57b260-c893-4eee-ba38-412997e80b59 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:03.261126 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-5910190d-97a4-419b-89bf-cac34fa34e32 req-3a57b260-c893-4eee-ba38-412997e80b59 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:03.278436 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-5910190d-97a4-419b-89bf-cac34fa34e32 req-3a57b260-c893-4eee-ba38-412997e80b59 service nova] Creating event network-changed:9bdcc1e0-93a1-4a48-839a-e6c7d4339e25 for instance e89e5bd3-ef0d-4314-b688-10af4dbf02a8 on hv-cinder-85987 Oct 03 14:53:03.285468 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-5910190d-97a4-419b-89bf-cac34fa34e32 req-3a57b260-c893-4eee-ba38-412997e80b59 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057286 Oct 03 14:53:03.286712 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 111/209] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:53:03.294634 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-1934436a-6f8f-48a7-9d85-aa97d4e6afb1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:03.295492 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-1934436a-6f8f-48a7-9d85-aa97d4e6afb1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:03.303840 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1934436a-6f8f-48a7-9d85-aa97d4e6afb1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:03.304691 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1934436a-6f8f-48a7-9d85-aa97d4e6afb1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:03.305318 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1934436a-6f8f-48a7-9d85-aa97d4e6afb1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:03.306165 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1934436a-6f8f-48a7-9d85-aa97d4e6afb1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:03.306829 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1934436a-6f8f-48a7-9d85-aa97d4e6afb1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:03.307343 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1934436a-6f8f-48a7-9d85-aa97d4e6afb1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:03.444078 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-1934436a-6f8f-48a7-9d85-aa97d4e6afb1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:03.452244 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-1934436a-6f8f-48a7-9d85-aa97d4e6afb1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1358 microversion: 2.1 time: 0.164147 Oct 03 14:53:03.452815 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 112/210] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:03 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:03.458226 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-9b38b165-9a9d-4902-ae51-8e5a073c4e14 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:03.459081 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-9b38b165-9a9d-4902-ae51-8e5a073c4e14 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:03.467089 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9b38b165-9a9d-4902-ae51-8e5a073c4e14 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:03.468144 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9b38b165-9a9d-4902-ae51-8e5a073c4e14 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:03.468659 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9b38b165-9a9d-4902-ae51-8e5a073c4e14 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:03.469583 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9b38b165-9a9d-4902-ae51-8e5a073c4e14 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:03.470116 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9b38b165-9a9d-4902-ae51-8e5a073c4e14 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:03.471186 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9b38b165-9a9d-4902-ae51-8e5a073c4e14 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:03.535815 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-9b38b165-9a9d-4902-ae51-8e5a073c4e14 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc880a31f5be4ea2a500bfa504749ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3f1ef0d0c343dfbf2eae49c0ea450c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:03.545345 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-9b38b165-9a9d-4902-ae51-8e5a073c4e14 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777" status: 200 len: 1211 microversion: 2.1 time: 0.090163 Oct 03 14:53:03.545345 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 113/211] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:03 2022] GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 => generated 1211 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:03.572133 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-08bae61d-5e97-47c0-b40d-c2396709ee00 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:03.572742 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-08bae61d-5e97-47c0-b40d-c2396709ee00 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:03.579778 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-08bae61d-5e97-47c0-b40d-c2396709ee00 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:03.580770 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-08bae61d-5e97-47c0-b40d-c2396709ee00 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:03.581218 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-08bae61d-5e97-47c0-b40d-c2396709ee00 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:03.581931 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-08bae61d-5e97-47c0-b40d-c2396709ee00 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:03.582385 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-08bae61d-5e97-47c0-b40d-c2396709ee00 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:03.582834 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-08bae61d-5e97-47c0-b40d-c2396709ee00 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:03.723052 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-08bae61d-5e97-47c0-b40d-c2396709ee00 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:03.735274 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-08bae61d-5e97-47c0-b40d-c2396709ee00 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1321 microversion: 2.1 time: 0.164900 Oct 03 14:53:03.735274 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 114/212] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:03 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:04.476454 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-28c5fbf1-4876-481f-b1c5-39b9d3ff8580 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:04.477785 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-28c5fbf1-4876-481f-b1c5-39b9d3ff8580 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:04.483894 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-28c5fbf1-4876-481f-b1c5-39b9d3ff8580 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:04.484376 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-28c5fbf1-4876-481f-b1c5-39b9d3ff8580 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:04.484805 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-28c5fbf1-4876-481f-b1c5-39b9d3ff8580 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:04.485524 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-28c5fbf1-4876-481f-b1c5-39b9d3ff8580 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:04.486604 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-28c5fbf1-4876-481f-b1c5-39b9d3ff8580 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:04.487045 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-28c5fbf1-4876-481f-b1c5-39b9d3ff8580 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:04.620110 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-28c5fbf1-4876-481f-b1c5-39b9d3ff8580 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:04.627687 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-28c5fbf1-4876-481f-b1c5-39b9d3ff8580 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1358 microversion: 2.1 time: 0.155077 Oct 03 14:53:04.628248 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 115/213] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:04 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:04.632539 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-0973a1ba-b82c-47a8-a575-fc9a23b9013e tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:04.633138 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-0973a1ba-b82c-47a8-a575-fc9a23b9013e tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:04.638780 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0973a1ba-b82c-47a8-a575-fc9a23b9013e tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:04.639262 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0973a1ba-b82c-47a8-a575-fc9a23b9013e tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:04.639688 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0973a1ba-b82c-47a8-a575-fc9a23b9013e tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:04.640639 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0973a1ba-b82c-47a8-a575-fc9a23b9013e tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:04.641097 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0973a1ba-b82c-47a8-a575-fc9a23b9013e tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:04.641714 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0973a1ba-b82c-47a8-a575-fc9a23b9013e tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:04.701070 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-0973a1ba-b82c-47a8-a575-fc9a23b9013e tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc880a31f5be4ea2a500bfa504749ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3f1ef0d0c343dfbf2eae49c0ea450c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:04.708976 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-0973a1ba-b82c-47a8-a575-fc9a23b9013e tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777" status: 200 len: 1211 microversion: 2.1 time: 0.079784 Oct 03 14:53:04.709557 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 116/214] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:04 2022] GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 => generated 1211 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:04.756201 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-33bd14ac-a4ba-4ae0-93a2-799d7d730c5a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:04.756801 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-33bd14ac-a4ba-4ae0-93a2-799d7d730c5a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:04.762800 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-33bd14ac-a4ba-4ae0-93a2-799d7d730c5a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:04.763292 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-33bd14ac-a4ba-4ae0-93a2-799d7d730c5a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:04.763713 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-33bd14ac-a4ba-4ae0-93a2-799d7d730c5a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:04.764393 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-33bd14ac-a4ba-4ae0-93a2-799d7d730c5a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:04.764838 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-33bd14ac-a4ba-4ae0-93a2-799d7d730c5a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:04.765253 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-33bd14ac-a4ba-4ae0-93a2-799d7d730c5a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:04.890658 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-33bd14ac-a4ba-4ae0-93a2-799d7d730c5a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:04.898670 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-33bd14ac-a4ba-4ae0-93a2-799d7d730c5a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1321 microversion: 2.1 time: 0.146389 Oct 03 14:53:04.899232 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 117/215] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:04 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:05.304013 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-4a5154b4-5a14-4f2a-851e-49ae2a1793e7 req-c3a2eba0-5bb5-4c29-9790-0f3c272b0857 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27879d6c-62f5-4281-b134-faecf706a2db", "tag": "abd33b94-cd03-47ad-bbbe-b38838da0555"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:53:05.313585 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-4a5154b4-5a14-4f2a-851e-49ae2a1793e7 req-c3a2eba0-5bb5-4c29-9790-0f3c272b0857 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:05.314559 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-4a5154b4-5a14-4f2a-851e-49ae2a1793e7 req-c3a2eba0-5bb5-4c29-9790-0f3c272b0857 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:05.314985 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-4a5154b4-5a14-4f2a-851e-49ae2a1793e7 req-c3a2eba0-5bb5-4c29-9790-0f3c272b0857 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:05.326778 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-4a5154b4-5a14-4f2a-851e-49ae2a1793e7 req-c3a2eba0-5bb5-4c29-9790-0f3c272b0857 service nova] Creating event network-changed:abd33b94-cd03-47ad-bbbe-b38838da0555 for instance 27879d6c-62f5-4281-b134-faecf706a2db on hv-cinder-85987 Oct 03 14:53:05.335974 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-4a5154b4-5a14-4f2a-851e-49ae2a1793e7 req-c3a2eba0-5bb5-4c29-9790-0f3c272b0857 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035449 Oct 03 14:53:05.336820 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 118/216] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:53:05.651114 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-091ff654-4d27-4c7b-92ed-ed28f5c3e5ea tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:05.651879 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-091ff654-4d27-4c7b-92ed-ed28f5c3e5ea tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:05.657871 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-091ff654-4d27-4c7b-92ed-ed28f5c3e5ea tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:05.658344 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-091ff654-4d27-4c7b-92ed-ed28f5c3e5ea tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:05.658769 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-091ff654-4d27-4c7b-92ed-ed28f5c3e5ea tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:05.659447 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-091ff654-4d27-4c7b-92ed-ed28f5c3e5ea tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:05.659893 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-091ff654-4d27-4c7b-92ed-ed28f5c3e5ea tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:05.660311 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-091ff654-4d27-4c7b-92ed-ed28f5c3e5ea tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:05.794170 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-091ff654-4d27-4c7b-92ed-ed28f5c3e5ea tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:05.802282 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-091ff654-4d27-4c7b-92ed-ed28f5c3e5ea tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1358 microversion: 2.1 time: 0.155462 Oct 03 14:53:05.802838 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 119/217] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:05 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:05.807065 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-be24e26d-06ec-4f70-b1cb-826a6dc04eb7 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:05.807653 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-be24e26d-06ec-4f70-b1cb-826a6dc04eb7 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:05.812913 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-be24e26d-06ec-4f70-b1cb-826a6dc04eb7 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:05.813382 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-be24e26d-06ec-4f70-b1cb-826a6dc04eb7 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:05.813842 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-be24e26d-06ec-4f70-b1cb-826a6dc04eb7 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:05.814513 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-be24e26d-06ec-4f70-b1cb-826a6dc04eb7 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:05.814958 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-be24e26d-06ec-4f70-b1cb-826a6dc04eb7 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:05.815368 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-be24e26d-06ec-4f70-b1cb-826a6dc04eb7 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:05.832365 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=100 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:05.875002 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-be24e26d-06ec-4f70-b1cb-826a6dc04eb7 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc880a31f5be4ea2a500bfa504749ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3f1ef0d0c343dfbf2eae49c0ea450c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:05.882364 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-be24e26d-06ec-4f70-b1cb-826a6dc04eb7 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777" status: 200 len: 1211 microversion: 2.1 time: 0.078604 Oct 03 14:53:05.882919 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 120/218] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:05 2022] GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 => generated 1211 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:05.920761 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-6ec47779-16b2-4c15-a519-e584a10d289b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:05.921345 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-6ec47779-16b2-4c15-a519-e584a10d289b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:05.927675 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6ec47779-16b2-4c15-a519-e584a10d289b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:05.928154 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6ec47779-16b2-4c15-a519-e584a10d289b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:05.928585 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6ec47779-16b2-4c15-a519-e584a10d289b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:05.929264 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6ec47779-16b2-4c15-a519-e584a10d289b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:05.929746 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6ec47779-16b2-4c15-a519-e584a10d289b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:05.930164 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6ec47779-16b2-4c15-a519-e584a10d289b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:06.053683 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-6ec47779-16b2-4c15-a519-e584a10d289b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:06.061152 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-6ec47779-16b2-4c15-a519-e584a10d289b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1321 microversion: 2.1 time: 0.143915 Oct 03 14:53:06.061738 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 121/219] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:05 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1321 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:06.824637 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-f16e03bd-a88a-4752-b842-6a951cf74331 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:06.825229 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-f16e03bd-a88a-4752-b842-6a951cf74331 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:06.831753 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f16e03bd-a88a-4752-b842-6a951cf74331 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:06.832236 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f16e03bd-a88a-4752-b842-6a951cf74331 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:06.832671 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f16e03bd-a88a-4752-b842-6a951cf74331 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:06.833362 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f16e03bd-a88a-4752-b842-6a951cf74331 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:06.833843 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f16e03bd-a88a-4752-b842-6a951cf74331 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:06.834315 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f16e03bd-a88a-4752-b842-6a951cf74331 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:06.960169 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-f16e03bd-a88a-4752-b842-6a951cf74331 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:06.967842 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-f16e03bd-a88a-4752-b842-6a951cf74331 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1358 microversion: 2.1 time: 0.146837 Oct 03 14:53:06.968405 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 122/220] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:06 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:06.972708 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-0cd710b0-b9c8-4e7c-8715-70372f20c2b7 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:06.973307 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-0cd710b0-b9c8-4e7c-8715-70372f20c2b7 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:06.978702 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0cd710b0-b9c8-4e7c-8715-70372f20c2b7 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:06.979180 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0cd710b0-b9c8-4e7c-8715-70372f20c2b7 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:06.979614 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0cd710b0-b9c8-4e7c-8715-70372f20c2b7 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:06.980302 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0cd710b0-b9c8-4e7c-8715-70372f20c2b7 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:06.980752 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0cd710b0-b9c8-4e7c-8715-70372f20c2b7 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:06.981173 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0cd710b0-b9c8-4e7c-8715-70372f20c2b7 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:07.038529 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-0cd710b0-b9c8-4e7c-8715-70372f20c2b7 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc880a31f5be4ea2a500bfa504749ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3f1ef0d0c343dfbf2eae49c0ea450c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:07.046021 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-0cd710b0-b9c8-4e7c-8715-70372f20c2b7 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777" status: 200 len: 1211 microversion: 2.1 time: 0.076642 Oct 03 14:53:07.046590 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 123/221] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:06 2022] GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 => generated 1211 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:07.082944 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-78327549-a325-4192-9c84-4846d63d5603 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:07.083482 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-78327549-a325-4192-9c84-4846d63d5603 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:07.089212 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-78327549-a325-4192-9c84-4846d63d5603 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:07.089727 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-78327549-a325-4192-9c84-4846d63d5603 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:07.090166 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-78327549-a325-4192-9c84-4846d63d5603 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:07.090855 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-78327549-a325-4192-9c84-4846d63d5603 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:07.091305 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-78327549-a325-4192-9c84-4846d63d5603 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:07.091727 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-78327549-a325-4192-9c84-4846d63d5603 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:07.224149 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-78327549-a325-4192-9c84-4846d63d5603 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:07.231815 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-78327549-a325-4192-9c84-4846d63d5603 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1321 microversion: 2.1 time: 0.152508 Oct 03 14:53:07.232589 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 124/222] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:07 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:07.990025 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-b4b1c509-298a-43d4-8d7d-f08632691aee tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:07.990627 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-b4b1c509-298a-43d4-8d7d-f08632691aee tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:07.996534 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b4b1c509-298a-43d4-8d7d-f08632691aee tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:07.997177 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b4b1c509-298a-43d4-8d7d-f08632691aee tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:07.997634 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b4b1c509-298a-43d4-8d7d-f08632691aee tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:07.998319 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b4b1c509-298a-43d4-8d7d-f08632691aee tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:07.998796 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b4b1c509-298a-43d4-8d7d-f08632691aee tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:07.999214 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b4b1c509-298a-43d4-8d7d-f08632691aee tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:08.295656 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-b4b1c509-298a-43d4-8d7d-f08632691aee tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:08.304453 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-b4b1c509-298a-43d4-8d7d-f08632691aee tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1358 microversion: 2.1 time: 0.317963 Oct 03 14:53:08.305121 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 125/223] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:07 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1358 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:08.310439 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-e162932d-c69a-4382-837b-866a30bc5a62 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:08.311508 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-e162932d-c69a-4382-837b-866a30bc5a62 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:08.318993 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e162932d-c69a-4382-837b-866a30bc5a62 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:08.319570 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e162932d-c69a-4382-837b-866a30bc5a62 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:08.320072 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e162932d-c69a-4382-837b-866a30bc5a62 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:08.320873 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e162932d-c69a-4382-837b-866a30bc5a62 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:08.321345 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e162932d-c69a-4382-837b-866a30bc5a62 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:08.321798 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e162932d-c69a-4382-837b-866a30bc5a62 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:08.400877 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-e162932d-c69a-4382-837b-866a30bc5a62 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc880a31f5be4ea2a500bfa504749ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3f1ef0d0c343dfbf2eae49c0ea450c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:08.413024 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-e162932d-c69a-4382-837b-866a30bc5a62 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777" status: 200 len: 1211 microversion: 2.1 time: 0.105889 Oct 03 14:53:08.413778 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 126/224] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:08 2022] GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 => generated 1211 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:08.418514 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-728f0225-b211-431b-ba18-3114e90a32e1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:08.419152 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-728f0225-b211-431b-ba18-3114e90a32e1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:08.425480 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-728f0225-b211-431b-ba18-3114e90a32e1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:08.426006 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-728f0225-b211-431b-ba18-3114e90a32e1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:08.426710 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-728f0225-b211-431b-ba18-3114e90a32e1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:08.427136 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-728f0225-b211-431b-ba18-3114e90a32e1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:08.427599 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-728f0225-b211-431b-ba18-3114e90a32e1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:08.428118 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-728f0225-b211-431b-ba18-3114e90a32e1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:08.516822 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell0:SELECT=2 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:08.581634 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-728f0225-b211-431b-ba18-3114e90a32e1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:08.591295 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-728f0225-b211-431b-ba18-3114e90a32e1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1515 microversion: 2.1 time: 0.175284 Oct 03 14:53:08.592016 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 127/225] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:08 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:08.616498 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-feb599b6-02ac-4d80-9bb2-f19814f14b80 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:53:08.619651 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-feb599b6-02ac-4d80-9bb2-f19814f14b80 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:08.625889 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-feb599b6-02ac-4d80-9bb2-f19814f14b80 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:08.627617 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-feb599b6-02ac-4d80-9bb2-f19814f14b80 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:08.627617 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-feb599b6-02ac-4d80-9bb2-f19814f14b80 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:08.631828 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-feb599b6-02ac-4d80-9bb2-f19814f14b80 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:08.632422 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-feb599b6-02ac-4d80-9bb2-f19814f14b80 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:08.632975 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-feb599b6-02ac-4d80-9bb2-f19814f14b80 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:08.665264 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.objects.instance [None req-feb599b6-02ac-4d80-9bb2-f19814f14b80 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lazy-loading 'flavor' on Instance uuid 193f7fe8-5737-49b3-a165-4345f3357042 {{(pid=126851) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:53:08.773480 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell0:SELECT=8 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:08.868184 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-feb599b6-02ac-4d80-9bb2-f19814f14b80 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "POST /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042/action" status: 200 len: 32 microversion: 2.1 time: 0.256037 Oct 03 14:53:08.869306 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 128/226] 10.222.0.46 () {60 vars in 1278 bytes} [Mon Oct 3 14:53:08 2022] POST /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042/action => generated 32 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:53:08.879896 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-edd6c05b-b794-492a-a456-ca1a8b3696be tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:08.880792 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-edd6c05b-b794-492a-a456-ca1a8b3696be tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:08.886182 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_api:SELECT=100 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:08.888830 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-edd6c05b-b794-492a-a456-ca1a8b3696be tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:08.889612 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-edd6c05b-b794-492a-a456-ca1a8b3696be tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:08.890286 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-edd6c05b-b794-492a-a456-ca1a8b3696be tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:08.891160 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-edd6c05b-b794-492a-a456-ca1a8b3696be tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:08.891738 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-edd6c05b-b794-492a-a456-ca1a8b3696be tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:08.892443 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-edd6c05b-b794-492a-a456-ca1a8b3696be tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:08.991493 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-1e301d9e-aa31-47cf-b062-759b5a0e1ce4 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "POST /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.690959 Oct 03 14:53:08.997976 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 99/227] 10.222.0.46 () {60 vars in 1323 bytes} [Mon Oct 3 14:53:02 2022] POST /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b/os-volume_attachments => generated 194 bytes in 6693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:53:09.106576 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-edd6c05b-b794-492a-a456-ca1a8b3696be tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:09.114818 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-edd6c05b-b794-492a-a456-ca1a8b3696be tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1521 microversion: 2.1 time: 0.239516 Oct 03 14:53:09.115386 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 129/228] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:08 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:09.330262 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-a10efa6a-6caa-4f45-b017-518329467d87 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:09.331077 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-a10efa6a-6caa-4f45-b017-518329467d87 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:09.337783 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a10efa6a-6caa-4f45-b017-518329467d87 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:09.338579 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a10efa6a-6caa-4f45-b017-518329467d87 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:09.339064 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a10efa6a-6caa-4f45-b017-518329467d87 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:09.339842 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a10efa6a-6caa-4f45-b017-518329467d87 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:09.340620 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a10efa6a-6caa-4f45-b017-518329467d87 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:09.341051 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a10efa6a-6caa-4f45-b017-518329467d87 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:09.440531 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-2b6fe5ba-fce2-444e-91ab-b839618b3534 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:09.441227 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-2b6fe5ba-fce2-444e-91ab-b839618b3534 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:09.448150 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2b6fe5ba-fce2-444e-91ab-b839618b3534 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:09.448690 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2b6fe5ba-fce2-444e-91ab-b839618b3534 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:09.449362 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2b6fe5ba-fce2-444e-91ab-b839618b3534 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:09.450225 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2b6fe5ba-fce2-444e-91ab-b839618b3534 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:09.450788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2b6fe5ba-fce2-444e-91ab-b839618b3534 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:09.451379 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2b6fe5ba-fce2-444e-91ab-b839618b3534 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:09.529044 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-2b6fe5ba-fce2-444e-91ab-b839618b3534 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc880a31f5be4ea2a500bfa504749ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3f1ef0d0c343dfbf2eae49c0ea450c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:09.530052 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-a10efa6a-6caa-4f45-b017-518329467d87 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:09.537364 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-2b6fe5ba-fce2-444e-91ab-b839618b3534 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777" status: 200 len: 1211 microversion: 2.1 time: 0.100859 Oct 03 14:53:09.538089 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 130/229] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:09 2022] GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 => generated 1211 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:09.549807 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-a10efa6a-6caa-4f45-b017-518329467d87 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1358 microversion: 2.1 time: 0.213924 Oct 03 14:53:09.549807 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 100/230] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:09 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1358 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:10.137794 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-37b6d0d5-c323-4421-81c2-16ddfd1e91d6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:10.138466 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-37b6d0d5-c323-4421-81c2-16ddfd1e91d6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:10.145843 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-37b6d0d5-c323-4421-81c2-16ddfd1e91d6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:10.146406 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-37b6d0d5-c323-4421-81c2-16ddfd1e91d6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:10.147041 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-37b6d0d5-c323-4421-81c2-16ddfd1e91d6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:10.147793 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-37b6d0d5-c323-4421-81c2-16ddfd1e91d6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:10.148467 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-37b6d0d5-c323-4421-81c2-16ddfd1e91d6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:10.149097 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-37b6d0d5-c323-4421-81c2-16ddfd1e91d6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:10.311473 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-37b6d0d5-c323-4421-81c2-16ddfd1e91d6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:10.321034 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-37b6d0d5-c323-4421-81c2-16ddfd1e91d6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1521 microversion: 2.1 time: 0.187397 Oct 03 14:53:10.321642 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 101/231] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:10 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:10.561982 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-bc56d086-34cf-4a48-b546-e7cfd792bdf1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:10.562852 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-bc56d086-34cf-4a48-b546-e7cfd792bdf1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:10.563087 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-bb0d0b6f-53f1-401a-a376-c30cc59ffdd1 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:10.564969 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-bb0d0b6f-53f1-401a-a376-c30cc59ffdd1 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:10.571260 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bb0d0b6f-53f1-401a-a376-c30cc59ffdd1 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:10.572087 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bb0d0b6f-53f1-401a-a376-c30cc59ffdd1 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:10.572397 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bc56d086-34cf-4a48-b546-e7cfd792bdf1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:10.572839 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bb0d0b6f-53f1-401a-a376-c30cc59ffdd1 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:10.572957 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bc56d086-34cf-4a48-b546-e7cfd792bdf1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:10.573528 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bc56d086-34cf-4a48-b546-e7cfd792bdf1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:10.574004 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bb0d0b6f-53f1-401a-a376-c30cc59ffdd1 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:10.574911 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bc56d086-34cf-4a48-b546-e7cfd792bdf1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:10.575097 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bb0d0b6f-53f1-401a-a376-c30cc59ffdd1 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:10.575682 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bb0d0b6f-53f1-401a-a376-c30cc59ffdd1 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:10.576082 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bc56d086-34cf-4a48-b546-e7cfd792bdf1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:10.576521 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bc56d086-34cf-4a48-b546-e7cfd792bdf1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:10.649667 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-bb0d0b6f-53f1-401a-a376-c30cc59ffdd1 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc880a31f5be4ea2a500bfa504749ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3f1ef0d0c343dfbf2eae49c0ea450c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:10.658825 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-bb0d0b6f-53f1-401a-a376-c30cc59ffdd1 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777" status: 200 len: 1211 microversion: 2.1 time: 0.100389 Oct 03 14:53:10.661544 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 102/232] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:10 2022] GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 => generated 1211 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:10.727738 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-bc56d086-34cf-4a48-b546-e7cfd792bdf1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:10.735408 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-bc56d086-34cf-4a48-b546-e7cfd792bdf1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1358 microversion: 2.1 time: 0.177542 Oct 03 14:53:10.736461 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 131/233] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:10 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:11.347731 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-019079a3-4860-4f50-b962-b465754f8492 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:11.348549 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-019079a3-4860-4f50-b962-b465754f8492 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:11.358180 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-019079a3-4860-4f50-b962-b465754f8492 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:11.359192 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-019079a3-4860-4f50-b962-b465754f8492 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:11.359904 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-019079a3-4860-4f50-b962-b465754f8492 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:11.362075 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-019079a3-4860-4f50-b962-b465754f8492 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:11.362556 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-019079a3-4860-4f50-b962-b465754f8492 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:11.363008 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-019079a3-4860-4f50-b962-b465754f8492 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:11.385695 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:11.509900 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-019079a3-4860-4f50-b962-b465754f8492 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:11.518409 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-019079a3-4860-4f50-b962-b465754f8492 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1521 microversion: 2.1 time: 0.176908 Oct 03 14:53:11.519022 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 103/234] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:11 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:11.682253 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-e8c025be-be5a-4605-85f5-7c2f43a26dac tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:11.682977 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-e8c025be-be5a-4605-85f5-7c2f43a26dac tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:11.689170 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e8c025be-be5a-4605-85f5-7c2f43a26dac tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:11.689775 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e8c025be-be5a-4605-85f5-7c2f43a26dac tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:11.690282 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e8c025be-be5a-4605-85f5-7c2f43a26dac tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:11.691046 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e8c025be-be5a-4605-85f5-7c2f43a26dac tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:11.691590 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e8c025be-be5a-4605-85f5-7c2f43a26dac tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:11.692084 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e8c025be-be5a-4605-85f5-7c2f43a26dac tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:11.760072 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-63095c38-ee03-4c68-8fbe-7bd679209bdd tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:11.760676 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-63095c38-ee03-4c68-8fbe-7bd679209bdd tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:11.769118 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-63095c38-ee03-4c68-8fbe-7bd679209bdd tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:11.770166 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-63095c38-ee03-4c68-8fbe-7bd679209bdd tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:11.770301 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-e8c025be-be5a-4605-85f5-7c2f43a26dac tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc880a31f5be4ea2a500bfa504749ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3f1ef0d0c343dfbf2eae49c0ea450c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:11.770888 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-63095c38-ee03-4c68-8fbe-7bd679209bdd tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:11.771974 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-63095c38-ee03-4c68-8fbe-7bd679209bdd tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:11.772613 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-63095c38-ee03-4c68-8fbe-7bd679209bdd tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:11.773432 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-63095c38-ee03-4c68-8fbe-7bd679209bdd tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:11.784754 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-e8c025be-be5a-4605-85f5-7c2f43a26dac tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777" status: 200 len: 1267 microversion: 2.1 time: 0.105443 Oct 03 14:53:11.785802 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 132/235] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:11 2022] GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 => generated 1267 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:11.910944 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-63095c38-ee03-4c68-8fbe-7bd679209bdd tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:11.919037 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-63095c38-ee03-4c68-8fbe-7bd679209bdd tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1358 microversion: 2.1 time: 0.164386 Oct 03 14:53:11.920123 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 104/236] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:11 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:12.541887 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-437755b5-406a-4656-8cfc-1f27083de7d8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:12.542805 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-437755b5-406a-4656-8cfc-1f27083de7d8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:12.549535 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-437755b5-406a-4656-8cfc-1f27083de7d8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:12.550030 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-437755b5-406a-4656-8cfc-1f27083de7d8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:12.550460 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-437755b5-406a-4656-8cfc-1f27083de7d8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:12.551261 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-437755b5-406a-4656-8cfc-1f27083de7d8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:12.551597 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-437755b5-406a-4656-8cfc-1f27083de7d8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:12.552183 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-437755b5-406a-4656-8cfc-1f27083de7d8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:12.690055 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-437755b5-406a-4656-8cfc-1f27083de7d8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:12.697559 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-437755b5-406a-4656-8cfc-1f27083de7d8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1521 microversion: 2.1 time: 0.160486 Oct 03 14:53:12.698211 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 133/237] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:12 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:12.807399 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-cb6e9e5c-8e04-41e5-b769-3008db074f0e tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:12.808006 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-cb6e9e5c-8e04-41e5-b769-3008db074f0e tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:12.814639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cb6e9e5c-8e04-41e5-b769-3008db074f0e tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:12.815120 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cb6e9e5c-8e04-41e5-b769-3008db074f0e tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:12.815578 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cb6e9e5c-8e04-41e5-b769-3008db074f0e tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:12.816272 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cb6e9e5c-8e04-41e5-b769-3008db074f0e tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:12.816955 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cb6e9e5c-8e04-41e5-b769-3008db074f0e tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:12.817377 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cb6e9e5c-8e04-41e5-b769-3008db074f0e tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:12.880652 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-cb6e9e5c-8e04-41e5-b769-3008db074f0e tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc880a31f5be4ea2a500bfa504749ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3f1ef0d0c343dfbf2eae49c0ea450c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:12.888963 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-cb6e9e5c-8e04-41e5-b769-3008db074f0e tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777" status: 200 len: 1267 microversion: 2.1 time: 0.085382 Oct 03 14:53:12.889555 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 105/238] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:12 2022] GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 => generated 1267 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:12.941568 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-d1f9eb72-3029-445d-bc52-37cfc24bb997 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:12.942173 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-d1f9eb72-3029-445d-bc52-37cfc24bb997 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:12.948035 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d1f9eb72-3029-445d-bc52-37cfc24bb997 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:12.948499 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d1f9eb72-3029-445d-bc52-37cfc24bb997 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:12.948928 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d1f9eb72-3029-445d-bc52-37cfc24bb997 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:12.949645 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d1f9eb72-3029-445d-bc52-37cfc24bb997 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:12.950093 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d1f9eb72-3029-445d-bc52-37cfc24bb997 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:12.950511 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d1f9eb72-3029-445d-bc52-37cfc24bb997 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:13.082546 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-d1f9eb72-3029-445d-bc52-37cfc24bb997 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:13.090333 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-d1f9eb72-3029-445d-bc52-37cfc24bb997 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1358 microversion: 2.1 time: 0.152565 Oct 03 14:53:13.090888 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 134/239] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:12 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:13.720623 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-cea78b01-b74c-4670-b011-ff2dedb106ed tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:13.721774 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-cea78b01-b74c-4670-b011-ff2dedb106ed tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:13.728692 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cea78b01-b74c-4670-b011-ff2dedb106ed tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:13.729178 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cea78b01-b74c-4670-b011-ff2dedb106ed tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:13.729654 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cea78b01-b74c-4670-b011-ff2dedb106ed tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:13.730377 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cea78b01-b74c-4670-b011-ff2dedb106ed tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:13.730795 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cea78b01-b74c-4670-b011-ff2dedb106ed tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:13.731220 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cea78b01-b74c-4670-b011-ff2dedb106ed tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:13.862640 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-cea78b01-b74c-4670-b011-ff2dedb106ed tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:13.872470 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-cea78b01-b74c-4670-b011-ff2dedb106ed tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1521 microversion: 2.1 time: 0.155535 Oct 03 14:53:13.873405 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 106/240] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:13 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:13.914684 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-3bcdae6e-fcc3-4613-aaeb-8fb831a814c6 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:13.915361 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-3bcdae6e-fcc3-4613-aaeb-8fb831a814c6 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:13.925242 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3bcdae6e-fcc3-4613-aaeb-8fb831a814c6 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:13.925831 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3bcdae6e-fcc3-4613-aaeb-8fb831a814c6 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:13.926553 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3bcdae6e-fcc3-4613-aaeb-8fb831a814c6 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:13.927319 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3bcdae6e-fcc3-4613-aaeb-8fb831a814c6 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:13.929229 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3bcdae6e-fcc3-4613-aaeb-8fb831a814c6 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:13.929872 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3bcdae6e-fcc3-4613-aaeb-8fb831a814c6 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:13.952823 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:14.002001 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-3bcdae6e-fcc3-4613-aaeb-8fb831a814c6 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc880a31f5be4ea2a500bfa504749ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3f1ef0d0c343dfbf2eae49c0ea450c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:14.012403 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-3bcdae6e-fcc3-4613-aaeb-8fb831a814c6 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777" status: 200 len: 1267 microversion: 2.1 time: 0.103402 Oct 03 14:53:14.013409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 135/241] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:13 2022] GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 => generated 1267 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:14.115085 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-eaeb336c-6d84-4cd4-a157-5d834fb59da0 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:14.115886 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-eaeb336c-6d84-4cd4-a157-5d834fb59da0 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:14.122895 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-eaeb336c-6d84-4cd4-a157-5d834fb59da0 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:14.123700 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-eaeb336c-6d84-4cd4-a157-5d834fb59da0 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:14.124343 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-eaeb336c-6d84-4cd4-a157-5d834fb59da0 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:14.125315 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-eaeb336c-6d84-4cd4-a157-5d834fb59da0 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:14.126052 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-eaeb336c-6d84-4cd4-a157-5d834fb59da0 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:14.126766 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-eaeb336c-6d84-4cd4-a157-5d834fb59da0 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:14.354511 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-eaeb336c-6d84-4cd4-a157-5d834fb59da0 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:14.363535 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-eaeb336c-6d84-4cd4-a157-5d834fb59da0 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1358 microversion: 2.1 time: 0.252870 Oct 03 14:53:14.364160 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 107/242] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:14 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:14.897148 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-d59a8915-d017-46b5-a522-c09135e7edba tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:14.898245 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-d59a8915-d017-46b5-a522-c09135e7edba tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:14.909748 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d59a8915-d017-46b5-a522-c09135e7edba tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:14.910230 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d59a8915-d017-46b5-a522-c09135e7edba tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:14.912395 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d59a8915-d017-46b5-a522-c09135e7edba tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:14.913141 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d59a8915-d017-46b5-a522-c09135e7edba tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:14.913636 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d59a8915-d017-46b5-a522-c09135e7edba tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:14.914064 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d59a8915-d017-46b5-a522-c09135e7edba tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:15.039558 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-24f89ee4-c156-4446-af06-e9919e8e607d tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:15.042136 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-24f89ee4-c156-4446-af06-e9919e8e607d tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:15.050333 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-24f89ee4-c156-4446-af06-e9919e8e607d tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:15.051155 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-24f89ee4-c156-4446-af06-e9919e8e607d tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:15.052029 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-24f89ee4-c156-4446-af06-e9919e8e607d tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:15.053774 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-24f89ee4-c156-4446-af06-e9919e8e607d tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:15.054398 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-24f89ee4-c156-4446-af06-e9919e8e607d tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:15.055091 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-24f89ee4-c156-4446-af06-e9919e8e607d tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:15.152063 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-d59a8915-d017-46b5-a522-c09135e7edba tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:15.160284 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-d59a8915-d017-46b5-a522-c09135e7edba tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1521 microversion: 2.1 time: 0.267191 Oct 03 14:53:15.176247 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 136/243] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:14 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:15.198538 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-24f89ee4-c156-4446-af06-e9919e8e607d tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc880a31f5be4ea2a500bfa504749ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3f1ef0d0c343dfbf2eae49c0ea450c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:15.206466 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-24f89ee4-c156-4446-af06-e9919e8e607d tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777" status: 200 len: 1275 microversion: 2.1 time: 0.170704 Oct 03 14:53:15.207303 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 108/244] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:15 2022] GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 => generated 1275 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:15.398878 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-d0dca51c-93d9-48e0-ae78-0a229c952965 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:15.399756 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-d0dca51c-93d9-48e0-ae78-0a229c952965 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:15.407606 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d0dca51c-93d9-48e0-ae78-0a229c952965 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:15.408333 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d0dca51c-93d9-48e0-ae78-0a229c952965 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:15.408832 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d0dca51c-93d9-48e0-ae78-0a229c952965 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:15.409631 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d0dca51c-93d9-48e0-ae78-0a229c952965 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:15.410172 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d0dca51c-93d9-48e0-ae78-0a229c952965 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:15.410753 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d0dca51c-93d9-48e0-ae78-0a229c952965 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:15.633534 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-d0dca51c-93d9-48e0-ae78-0a229c952965 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:15.641420 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-d0dca51c-93d9-48e0-ae78-0a229c952965 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1358 microversion: 2.1 time: 0.258469 Oct 03 14:53:15.642179 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 137/245] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:15 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1358 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:16.182794 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-c574b4a9-5d01-404c-9379-77bda7284508 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:16.183402 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-c574b4a9-5d01-404c-9379-77bda7284508 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:16.190335 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c574b4a9-5d01-404c-9379-77bda7284508 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:16.190818 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c574b4a9-5d01-404c-9379-77bda7284508 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:16.191253 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c574b4a9-5d01-404c-9379-77bda7284508 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:16.191941 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c574b4a9-5d01-404c-9379-77bda7284508 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:16.192398 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c574b4a9-5d01-404c-9379-77bda7284508 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:16.192819 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c574b4a9-5d01-404c-9379-77bda7284508 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:16.229976 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-d869e86f-4192-4ccd-be07-9b5d61f32421 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:16.230515 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-d869e86f-4192-4ccd-be07-9b5d61f32421 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:16.238818 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d869e86f-4192-4ccd-be07-9b5d61f32421 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:16.239578 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d869e86f-4192-4ccd-be07-9b5d61f32421 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:16.240012 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d869e86f-4192-4ccd-be07-9b5d61f32421 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:16.240723 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d869e86f-4192-4ccd-be07-9b5d61f32421 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:16.241180 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d869e86f-4192-4ccd-be07-9b5d61f32421 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:16.241633 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d869e86f-4192-4ccd-be07-9b5d61f32421 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:16.314399 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-d869e86f-4192-4ccd-be07-9b5d61f32421 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc880a31f5be4ea2a500bfa504749ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3f1ef0d0c343dfbf2eae49c0ea450c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:16.321948 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-d869e86f-4192-4ccd-be07-9b5d61f32421 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777" status: 200 len: 1273 microversion: 2.1 time: 0.095709 Oct 03 14:53:16.322707 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 138/246] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:16 2022] GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 => generated 1273 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:16.331209 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-c574b4a9-5d01-404c-9379-77bda7284508 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:16.339253 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-c574b4a9-5d01-404c-9379-77bda7284508 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1521 microversion: 2.1 time: 0.160203 Oct 03 14:53:16.339827 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 109/247] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:16 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:16.664608 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-0b13713b-27d8-4079-a35a-035ab608edc4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:16.665319 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-0b13713b-27d8-4079-a35a-035ab608edc4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:16.672587 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0b13713b-27d8-4079-a35a-035ab608edc4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:16.673828 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0b13713b-27d8-4079-a35a-035ab608edc4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:16.674478 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0b13713b-27d8-4079-a35a-035ab608edc4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:16.675447 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0b13713b-27d8-4079-a35a-035ab608edc4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:16.676130 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0b13713b-27d8-4079-a35a-035ab608edc4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:16.676731 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0b13713b-27d8-4079-a35a-035ab608edc4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:16.921599 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-0b13713b-27d8-4079-a35a-035ab608edc4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:16.930887 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-0b13713b-27d8-4079-a35a-035ab608edc4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1358 microversion: 2.1 time: 0.270252 Oct 03 14:53:16.931752 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 139/248] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:16 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1358 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:17.320565 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-7192ae5e-8b95-46f2-b57f-b9ce8f164e5c req-db58f251-537e-4bf2-ae6a-e1de9b00d185 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2b52a25-aa5a-4517-b43a-5f7648431777", "tag": "35f10418-cb11-4f70-8187-1d74218f400c"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:53:17.335411 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-7192ae5e-8b95-46f2-b57f-b9ce8f164e5c req-db58f251-537e-4bf2-ae6a-e1de9b00d185 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:17.336593 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-7192ae5e-8b95-46f2-b57f-b9ce8f164e5c req-db58f251-537e-4bf2-ae6a-e1de9b00d185 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:17.337399 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-7192ae5e-8b95-46f2-b57f-b9ce8f164e5c req-db58f251-537e-4bf2-ae6a-e1de9b00d185 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:17.350008 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-97d7855e-a613-4676-bfa5-3c8d72731436 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:17.352402 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-97d7855e-a613-4676-bfa5-3c8d72731436 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:17.369968 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-97d7855e-a613-4676-bfa5-3c8d72731436 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:17.370865 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-97d7855e-a613-4676-bfa5-3c8d72731436 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:17.372447 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-97d7855e-a613-4676-bfa5-3c8d72731436 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:17.377173 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-97d7855e-a613-4676-bfa5-3c8d72731436 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:17.377930 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-97d7855e-a613-4676-bfa5-3c8d72731436 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:17.386722 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-97d7855e-a613-4676-bfa5-3c8d72731436 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:17.400410 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-7192ae5e-8b95-46f2-b57f-b9ce8f164e5c req-db58f251-537e-4bf2-ae6a-e1de9b00d185 service nova] Creating event network-changed:35f10418-cb11-4f70-8187-1d74218f400c for instance a2b52a25-aa5a-4517-b43a-5f7648431777 on hv-cinder-85987 Oct 03 14:53:17.411915 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-7192ae5e-8b95-46f2-b57f-b9ce8f164e5c req-db58f251-537e-4bf2-ae6a-e1de9b00d185 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096823 Oct 03 14:53:17.413023 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 110/249] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:53:17.419275 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-21b05fa9-06a4-4b40-90bb-24567c6d5f66 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:17.420013 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-21b05fa9-06a4-4b40-90bb-24567c6d5f66 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:17.427130 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-21b05fa9-06a4-4b40-90bb-24567c6d5f66 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:17.427900 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-21b05fa9-06a4-4b40-90bb-24567c6d5f66 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:17.428554 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-21b05fa9-06a4-4b40-90bb-24567c6d5f66 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:17.429319 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-21b05fa9-06a4-4b40-90bb-24567c6d5f66 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:17.430266 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-21b05fa9-06a4-4b40-90bb-24567c6d5f66 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:17.431282 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-21b05fa9-06a4-4b40-90bb-24567c6d5f66 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:17.582905 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-21b05fa9-06a4-4b40-90bb-24567c6d5f66 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:17.591758 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-21b05fa9-06a4-4b40-90bb-24567c6d5f66 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1521 microversion: 2.1 time: 0.177341 Oct 03 14:53:17.592696 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 111/250] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:17 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:17.598820 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-aba2272b-e4d3-4dd5-9a85-475085fdee45 req-da17e212-f187-449f-b28c-7bda63d378fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bac89fd1-5f09-42a7-90f2-5074c12859fc", "name": "network-vif-plugged", "status": "completed", "tag": "8e144fc1-dc68-4200-84eb-87fed3d70fcb"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:53:17.609177 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-aba2272b-e4d3-4dd5-9a85-475085fdee45 req-da17e212-f187-449f-b28c-7bda63d378fa service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:17.610246 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-aba2272b-e4d3-4dd5-9a85-475085fdee45 req-da17e212-f187-449f-b28c-7bda63d378fa service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:17.610866 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-aba2272b-e4d3-4dd5-9a85-475085fdee45 req-da17e212-f187-449f-b28c-7bda63d378fa service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:17.623744 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-aba2272b-e4d3-4dd5-9a85-475085fdee45 req-da17e212-f187-449f-b28c-7bda63d378fa service nova] Creating event network-vif-plugged:8e144fc1-dc68-4200-84eb-87fed3d70fcb for instance bac89fd1-5f09-42a7-90f2-5074c12859fc on hv-cinder-85987 Oct 03 14:53:17.625908 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-97d7855e-a613-4676-bfa5-3c8d72731436 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc880a31f5be4ea2a500bfa504749ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3f1ef0d0c343dfbf2eae49c0ea450c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:17.630297 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-aba2272b-e4d3-4dd5-9a85-475085fdee45 req-da17e212-f187-449f-b28c-7bda63d378fa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036233 Oct 03 14:53:17.631582 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 112/251] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:53:17.638450 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-97d7855e-a613-4676-bfa5-3c8d72731436 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777" status: 200 len: 1315 microversion: 2.1 time: 0.295930 Oct 03 14:53:17.639148 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 140/252] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:17 2022] GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:17.956711 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-0943455a-72d0-47d0-a1a7-64661c38b9f4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:17.957316 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-0943455a-72d0-47d0-a1a7-64661c38b9f4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:17.963481 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0943455a-72d0-47d0-a1a7-64661c38b9f4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:17.963963 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0943455a-72d0-47d0-a1a7-64661c38b9f4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:17.964397 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0943455a-72d0-47d0-a1a7-64661c38b9f4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:17.965085 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0943455a-72d0-47d0-a1a7-64661c38b9f4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:17.965559 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0943455a-72d0-47d0-a1a7-64661c38b9f4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:17.965987 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0943455a-72d0-47d0-a1a7-64661c38b9f4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:18.095159 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-0943455a-72d0-47d0-a1a7-64661c38b9f4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:18.102952 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-0943455a-72d0-47d0-a1a7-64661c38b9f4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1358 microversion: 2.1 time: 0.151268 Oct 03 14:53:18.103521 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 113/253] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:17 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:18.627951 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-d4c4dee4-3562-4260-aedf-39de5c493046 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:18.628556 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-d4c4dee4-3562-4260-aedf-39de5c493046 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:18.634420 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d4c4dee4-3562-4260-aedf-39de5c493046 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:18.634896 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d4c4dee4-3562-4260-aedf-39de5c493046 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:18.635324 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d4c4dee4-3562-4260-aedf-39de5c493046 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:18.635997 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d4c4dee4-3562-4260-aedf-39de5c493046 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:18.636444 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d4c4dee4-3562-4260-aedf-39de5c493046 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:18.636857 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d4c4dee4-3562-4260-aedf-39de5c493046 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:18.662519 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-969d23d2-400c-4cab-924d-3d41f4ce1dfb tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:18.663129 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-969d23d2-400c-4cab-924d-3d41f4ce1dfb tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:18.673663 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-969d23d2-400c-4cab-924d-3d41f4ce1dfb tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:18.674261 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-969d23d2-400c-4cab-924d-3d41f4ce1dfb tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:18.674806 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-969d23d2-400c-4cab-924d-3d41f4ce1dfb tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:18.675745 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-969d23d2-400c-4cab-924d-3d41f4ce1dfb tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:18.676341 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-969d23d2-400c-4cab-924d-3d41f4ce1dfb tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:18.676867 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-969d23d2-400c-4cab-924d-3d41f4ce1dfb tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:18.765439 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-d4c4dee4-3562-4260-aedf-39de5c493046 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:18.773419 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-d4c4dee4-3562-4260-aedf-39de5c493046 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1521 microversion: 2.1 time: 0.149185 Oct 03 14:53:18.774052 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 141/254] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:18 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:18.819389 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-969d23d2-400c-4cab-924d-3d41f4ce1dfb tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc880a31f5be4ea2a500bfa504749ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3f1ef0d0c343dfbf2eae49c0ea450c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:18.826964 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-969d23d2-400c-4cab-924d-3d41f4ce1dfb tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777" status: 200 len: 1315 microversion: 2.1 time: 0.168188 Oct 03 14:53:18.827521 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 114/255] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:18 2022] GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:19.125933 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-a02cba31-0347-41bf-922c-c7081bb3181a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:19.126503 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-a02cba31-0347-41bf-922c-c7081bb3181a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:19.132354 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a02cba31-0347-41bf-922c-c7081bb3181a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:19.132835 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a02cba31-0347-41bf-922c-c7081bb3181a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:19.133271 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a02cba31-0347-41bf-922c-c7081bb3181a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:19.133985 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a02cba31-0347-41bf-922c-c7081bb3181a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:19.134445 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a02cba31-0347-41bf-922c-c7081bb3181a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:19.134873 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a02cba31-0347-41bf-922c-c7081bb3181a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:19.259158 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-a02cba31-0347-41bf-922c-c7081bb3181a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:19.267439 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-a02cba31-0347-41bf-922c-c7081bb3181a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1358 microversion: 2.1 time: 0.145401 Oct 03 14:53:19.268040 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 142/256] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:19 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:19.796616 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-44d121aa-2f86-4a12-bdc8-d83e58ea6bb5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:19.797217 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-44d121aa-2f86-4a12-bdc8-d83e58ea6bb5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:19.804053 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-44d121aa-2f86-4a12-bdc8-d83e58ea6bb5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:19.804534 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-44d121aa-2f86-4a12-bdc8-d83e58ea6bb5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:19.804958 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-44d121aa-2f86-4a12-bdc8-d83e58ea6bb5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:19.805673 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-44d121aa-2f86-4a12-bdc8-d83e58ea6bb5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:19.806126 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-44d121aa-2f86-4a12-bdc8-d83e58ea6bb5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:19.806544 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-44d121aa-2f86-4a12-bdc8-d83e58ea6bb5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:19.849976 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-c8356adb-0cae-40e0-8fa6-3cb97d02af25 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:19.850575 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-c8356adb-0cae-40e0-8fa6-3cb97d02af25 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:19.856354 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c8356adb-0cae-40e0-8fa6-3cb97d02af25 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:19.856828 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c8356adb-0cae-40e0-8fa6-3cb97d02af25 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:19.857253 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c8356adb-0cae-40e0-8fa6-3cb97d02af25 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:19.858080 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c8356adb-0cae-40e0-8fa6-3cb97d02af25 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:19.858536 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c8356adb-0cae-40e0-8fa6-3cb97d02af25 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:19.858952 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c8356adb-0cae-40e0-8fa6-3cb97d02af25 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:19.934445 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-44d121aa-2f86-4a12-bdc8-d83e58ea6bb5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:19.942708 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-44d121aa-2f86-4a12-bdc8-d83e58ea6bb5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1521 microversion: 2.1 time: 0.149801 Oct 03 14:53:19.943286 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 115/257] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:19 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:19.987883 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-c8356adb-0cae-40e0-8fa6-3cb97d02af25 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc880a31f5be4ea2a500bfa504749ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3f1ef0d0c343dfbf2eae49c0ea450c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:19.995409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-c8356adb-0cae-40e0-8fa6-3cb97d02af25 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777" status: 200 len: 1315 microversion: 2.1 time: 0.149165 Oct 03 14:53:19.995962 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 143/258] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:19 2022] GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:20.289814 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-527b7f94-62d5-4300-a70e-07c3dd8fad97 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:20.290418 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-527b7f94-62d5-4300-a70e-07c3dd8fad97 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:20.296895 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-527b7f94-62d5-4300-a70e-07c3dd8fad97 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:20.297055 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-527b7f94-62d5-4300-a70e-07c3dd8fad97 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:20.298231 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-527b7f94-62d5-4300-a70e-07c3dd8fad97 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:20.298947 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-527b7f94-62d5-4300-a70e-07c3dd8fad97 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:20.299409 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-527b7f94-62d5-4300-a70e-07c3dd8fad97 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:20.299836 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-527b7f94-62d5-4300-a70e-07c3dd8fad97 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:20.428070 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-527b7f94-62d5-4300-a70e-07c3dd8fad97 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:20.435698 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-527b7f94-62d5-4300-a70e-07c3dd8fad97 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1358 microversion: 2.1 time: 0.149849 Oct 03 14:53:20.436277 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 116/259] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:20 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:20.965383 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-f00e7413-8dfe-4a45-a253-2edd46de3d02 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:20.965924 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-f00e7413-8dfe-4a45-a253-2edd46de3d02 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:20.972066 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f00e7413-8dfe-4a45-a253-2edd46de3d02 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:20.972535 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f00e7413-8dfe-4a45-a253-2edd46de3d02 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:20.972960 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f00e7413-8dfe-4a45-a253-2edd46de3d02 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:20.973671 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f00e7413-8dfe-4a45-a253-2edd46de3d02 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:20.974118 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f00e7413-8dfe-4a45-a253-2edd46de3d02 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:20.974534 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f00e7413-8dfe-4a45-a253-2edd46de3d02 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:21.022507 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-defeb0b0-3a2d-4005-9d5e-37a1d82e0846 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:21.023201 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-defeb0b0-3a2d-4005-9d5e-37a1d82e0846 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:21.030346 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-defeb0b0-3a2d-4005-9d5e-37a1d82e0846 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:21.030889 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-defeb0b0-3a2d-4005-9d5e-37a1d82e0846 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:21.031507 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-defeb0b0-3a2d-4005-9d5e-37a1d82e0846 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:21.032405 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-defeb0b0-3a2d-4005-9d5e-37a1d82e0846 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:21.032868 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-defeb0b0-3a2d-4005-9d5e-37a1d82e0846 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:21.033297 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-defeb0b0-3a2d-4005-9d5e-37a1d82e0846 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:21.101670 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-f00e7413-8dfe-4a45-a253-2edd46de3d02 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:21.110518 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-f00e7413-8dfe-4a45-a253-2edd46de3d02 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1521 microversion: 2.1 time: 0.147996 Oct 03 14:53:21.110994 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 144/260] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:20 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:21.166979 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-defeb0b0-3a2d-4005-9d5e-37a1d82e0846 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc880a31f5be4ea2a500bfa504749ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3f1ef0d0c343dfbf2eae49c0ea450c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:21.175338 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-defeb0b0-3a2d-4005-9d5e-37a1d82e0846 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777" status: 200 len: 1315 microversion: 2.1 time: 0.160847 Oct 03 14:53:21.175899 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 117/261] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:21 2022] GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:21.458012 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-2f5c9926-aee7-4fc0-8d26-3fe1bde8967d tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:21.458614 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-2f5c9926-aee7-4fc0-8d26-3fe1bde8967d tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:21.464462 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2f5c9926-aee7-4fc0-8d26-3fe1bde8967d tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:21.464939 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2f5c9926-aee7-4fc0-8d26-3fe1bde8967d tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:21.465368 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2f5c9926-aee7-4fc0-8d26-3fe1bde8967d tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:21.466078 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2f5c9926-aee7-4fc0-8d26-3fe1bde8967d tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:21.466530 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2f5c9926-aee7-4fc0-8d26-3fe1bde8967d tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:21.466949 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2f5c9926-aee7-4fc0-8d26-3fe1bde8967d tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:21.593872 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-2f5c9926-aee7-4fc0-8d26-3fe1bde8967d tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:21.601950 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-2f5c9926-aee7-4fc0-8d26-3fe1bde8967d tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1358 microversion: 2.1 time: 0.147775 Oct 03 14:53:21.602515 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 145/262] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:21 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:22.132663 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-95e63b2b-fc1c-4652-b0d2-1c83aea15776 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:22.133183 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-95e63b2b-fc1c-4652-b0d2-1c83aea15776 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:22.136579 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:22.140426 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-95e63b2b-fc1c-4652-b0d2-1c83aea15776 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:22.140901 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-95e63b2b-fc1c-4652-b0d2-1c83aea15776 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:22.141873 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-95e63b2b-fc1c-4652-b0d2-1c83aea15776 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:22.142549 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-95e63b2b-fc1c-4652-b0d2-1c83aea15776 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:22.142999 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-95e63b2b-fc1c-4652-b0d2-1c83aea15776 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:22.143415 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-95e63b2b-fc1c-4652-b0d2-1c83aea15776 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:22.198999 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-04266447-7449-40d5-9e0d-30900d4063f4 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:22.199608 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-04266447-7449-40d5-9e0d-30900d4063f4 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:22.205867 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-04266447-7449-40d5-9e0d-30900d4063f4 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:22.206341 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-04266447-7449-40d5-9e0d-30900d4063f4 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:22.206766 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-04266447-7449-40d5-9e0d-30900d4063f4 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:22.207440 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-04266447-7449-40d5-9e0d-30900d4063f4 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:22.207892 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-04266447-7449-40d5-9e0d-30900d4063f4 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:22.208308 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-04266447-7449-40d5-9e0d-30900d4063f4 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:22.270905 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-95e63b2b-fc1c-4652-b0d2-1c83aea15776 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:22.278606 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-95e63b2b-fc1c-4652-b0d2-1c83aea15776 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1521 microversion: 2.1 time: 0.149755 Oct 03 14:53:22.285667 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 118/263] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:22 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:22.336950 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-04266447-7449-40d5-9e0d-30900d4063f4 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc880a31f5be4ea2a500bfa504749ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3f1ef0d0c343dfbf2eae49c0ea450c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:22.344750 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-04266447-7449-40d5-9e0d-30900d4063f4 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777" status: 200 len: 1315 microversion: 2.1 time: 0.149686 Oct 03 14:53:22.345305 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 146/264] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:22 2022] GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:22.625266 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-b7b9a4c4-6b63-49f1-9460-13994b0df737 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:22.626471 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-b7b9a4c4-6b63-49f1-9460-13994b0df737 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:22.632639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b7b9a4c4-6b63-49f1-9460-13994b0df737 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:22.633129 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b7b9a4c4-6b63-49f1-9460-13994b0df737 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:22.633595 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b7b9a4c4-6b63-49f1-9460-13994b0df737 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:22.634292 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b7b9a4c4-6b63-49f1-9460-13994b0df737 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:22.634749 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b7b9a4c4-6b63-49f1-9460-13994b0df737 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:22.635171 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b7b9a4c4-6b63-49f1-9460-13994b0df737 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:22.769293 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-b7b9a4c4-6b63-49f1-9460-13994b0df737 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:22.776873 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-b7b9a4c4-6b63-49f1-9460-13994b0df737 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1358 microversion: 2.1 time: 0.156639 Oct 03 14:53:22.777739 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 119/265] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:22 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:23.302274 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-c9cc767f-5ba9-41c8-ab3c-cc833953435a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:23.302938 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-c9cc767f-5ba9-41c8-ab3c-cc833953435a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:23.308631 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c9cc767f-5ba9-41c8-ab3c-cc833953435a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:23.309105 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c9cc767f-5ba9-41c8-ab3c-cc833953435a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:23.309563 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c9cc767f-5ba9-41c8-ab3c-cc833953435a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:23.310239 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c9cc767f-5ba9-41c8-ab3c-cc833953435a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:23.310686 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c9cc767f-5ba9-41c8-ab3c-cc833953435a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:23.311100 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c9cc767f-5ba9-41c8-ab3c-cc833953435a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:23.367283 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-a5ff2196-e92b-45de-9660-0f495e7136b1 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:23.367890 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-a5ff2196-e92b-45de-9660-0f495e7136b1 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:23.374440 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a5ff2196-e92b-45de-9660-0f495e7136b1 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:23.374925 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a5ff2196-e92b-45de-9660-0f495e7136b1 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:23.375359 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a5ff2196-e92b-45de-9660-0f495e7136b1 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:23.376049 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a5ff2196-e92b-45de-9660-0f495e7136b1 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:23.376503 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a5ff2196-e92b-45de-9660-0f495e7136b1 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:23.376922 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a5ff2196-e92b-45de-9660-0f495e7136b1 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:23.437895 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-c9cc767f-5ba9-41c8-ab3c-cc833953435a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:23.445616 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-c9cc767f-5ba9-41c8-ab3c-cc833953435a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1521 microversion: 2.1 time: 0.147821 Oct 03 14:53:23.446188 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 147/266] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:23 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:23.504315 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-a5ff2196-e92b-45de-9660-0f495e7136b1 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc880a31f5be4ea2a500bfa504749ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3f1ef0d0c343dfbf2eae49c0ea450c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:23.511893 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-a5ff2196-e92b-45de-9660-0f495e7136b1 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777" status: 200 len: 1315 microversion: 2.1 time: 0.148424 Oct 03 14:53:23.512465 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 120/267] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:23 2022] GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:23.798558 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-ddecc4b0-db1a-4678-8870-e33cf7c20014 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:23.799217 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-ddecc4b0-db1a-4678-8870-e33cf7c20014 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:23.805011 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ddecc4b0-db1a-4678-8870-e33cf7c20014 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:23.805491 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ddecc4b0-db1a-4678-8870-e33cf7c20014 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:23.805961 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ddecc4b0-db1a-4678-8870-e33cf7c20014 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:23.806643 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ddecc4b0-db1a-4678-8870-e33cf7c20014 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:23.807094 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ddecc4b0-db1a-4678-8870-e33cf7c20014 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:23.807514 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ddecc4b0-db1a-4678-8870-e33cf7c20014 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:23.930885 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-ddecc4b0-db1a-4678-8870-e33cf7c20014 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:23.938858 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-ddecc4b0-db1a-4678-8870-e33cf7c20014 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1358 microversion: 2.1 time: 0.143607 Oct 03 14:53:23.939808 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 148/268] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:23 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1358 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:24.468479 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-2a622bad-db8b-4f25-93c7-5f561f2735b6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:24.469104 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-2a622bad-db8b-4f25-93c7-5f561f2735b6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:24.475257 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2a622bad-db8b-4f25-93c7-5f561f2735b6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:24.475739 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2a622bad-db8b-4f25-93c7-5f561f2735b6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:24.476172 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2a622bad-db8b-4f25-93c7-5f561f2735b6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:24.476852 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2a622bad-db8b-4f25-93c7-5f561f2735b6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:24.477304 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2a622bad-db8b-4f25-93c7-5f561f2735b6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:24.477817 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2a622bad-db8b-4f25-93c7-5f561f2735b6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:24.495931 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=100 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:24.535657 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-04d6b8fb-566c-4bfb-941d-8704a4b54993 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:24.536381 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-04d6b8fb-566c-4bfb-941d-8704a4b54993 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:24.542798 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-04d6b8fb-566c-4bfb-941d-8704a4b54993 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:24.543282 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-04d6b8fb-566c-4bfb-941d-8704a4b54993 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:24.543968 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-04d6b8fb-566c-4bfb-941d-8704a4b54993 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:24.544705 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-04d6b8fb-566c-4bfb-941d-8704a4b54993 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:24.545168 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-04d6b8fb-566c-4bfb-941d-8704a4b54993 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:24.545615 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-04d6b8fb-566c-4bfb-941d-8704a4b54993 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:24.615298 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-2a622bad-db8b-4f25-93c7-5f561f2735b6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:24.623425 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-2a622bad-db8b-4f25-93c7-5f561f2735b6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1521 microversion: 2.1 time: 0.159133 Oct 03 14:53:24.623996 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 121/269] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:24 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:24.681860 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-04d6b8fb-566c-4bfb-941d-8704a4b54993 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc880a31f5be4ea2a500bfa504749ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3f1ef0d0c343dfbf2eae49c0ea450c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:24.690032 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-04d6b8fb-566c-4bfb-941d-8704a4b54993 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777" status: 200 len: 1315 microversion: 2.1 time: 0.158792 Oct 03 14:53:24.690748 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 149/270] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:24 2022] GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:24.961120 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-fafc5a32-efd3-4390-b679-473dc48f3a83 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:24.961778 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-fafc5a32-efd3-4390-b679-473dc48f3a83 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:24.967781 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fafc5a32-efd3-4390-b679-473dc48f3a83 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:24.968264 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fafc5a32-efd3-4390-b679-473dc48f3a83 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:24.968692 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fafc5a32-efd3-4390-b679-473dc48f3a83 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:24.969999 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fafc5a32-efd3-4390-b679-473dc48f3a83 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:24.970449 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fafc5a32-efd3-4390-b679-473dc48f3a83 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:24.970866 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fafc5a32-efd3-4390-b679-473dc48f3a83 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:25.095996 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-fafc5a32-efd3-4390-b679-473dc48f3a83 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:25.103651 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-fafc5a32-efd3-4390-b679-473dc48f3a83 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1358 microversion: 2.1 time: 0.146343 Oct 03 14:53:25.104252 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 122/271] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:24 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:25.646400 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-c27c6775-e40e-4086-acd6-74bcb6d47224 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:25.647007 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-c27c6775-e40e-4086-acd6-74bcb6d47224 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:25.652881 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c27c6775-e40e-4086-acd6-74bcb6d47224 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:25.653357 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c27c6775-e40e-4086-acd6-74bcb6d47224 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:25.653859 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c27c6775-e40e-4086-acd6-74bcb6d47224 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:25.654598 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c27c6775-e40e-4086-acd6-74bcb6d47224 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:25.655050 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c27c6775-e40e-4086-acd6-74bcb6d47224 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:25.655466 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c27c6775-e40e-4086-acd6-74bcb6d47224 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:25.713582 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-3bca0b14-f5c8-4ae4-a1c8-c1c3ccd73797 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:25.714314 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-3bca0b14-f5c8-4ae4-a1c8-c1c3ccd73797 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:25.721194 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3bca0b14-f5c8-4ae4-a1c8-c1c3ccd73797 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:25.721797 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3bca0b14-f5c8-4ae4-a1c8-c1c3ccd73797 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:25.722370 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3bca0b14-f5c8-4ae4-a1c8-c1c3ccd73797 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:25.723252 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3bca0b14-f5c8-4ae4-a1c8-c1c3ccd73797 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:25.723716 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3bca0b14-f5c8-4ae4-a1c8-c1c3ccd73797 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:25.724150 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3bca0b14-f5c8-4ae4-a1c8-c1c3ccd73797 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:25.783155 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-c27c6775-e40e-4086-acd6-74bcb6d47224 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:25.790844 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-c27c6775-e40e-4086-acd6-74bcb6d47224 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1521 microversion: 2.1 time: 0.148190 Oct 03 14:53:25.791445 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 150/272] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:25 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:25.854760 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-3bca0b14-f5c8-4ae4-a1c8-c1c3ccd73797 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc880a31f5be4ea2a500bfa504749ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3f1ef0d0c343dfbf2eae49c0ea450c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:25.862272 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-3bca0b14-f5c8-4ae4-a1c8-c1c3ccd73797 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777" status: 200 len: 1315 microversion: 2.1 time: 0.152605 Oct 03 14:53:25.862833 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 123/273] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:25 2022] GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:26.126764 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-098f4319-cc17-49ce-aece-6a471b4609d5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:26.127375 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-098f4319-cc17-49ce-aece-6a471b4609d5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:26.133307 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-098f4319-cc17-49ce-aece-6a471b4609d5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:26.133829 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-098f4319-cc17-49ce-aece-6a471b4609d5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:26.134268 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-098f4319-cc17-49ce-aece-6a471b4609d5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:26.135100 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-098f4319-cc17-49ce-aece-6a471b4609d5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:26.135564 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-098f4319-cc17-49ce-aece-6a471b4609d5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:26.135988 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-098f4319-cc17-49ce-aece-6a471b4609d5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:26.263899 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-098f4319-cc17-49ce-aece-6a471b4609d5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:26.267934 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=100 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:26.273061 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-098f4319-cc17-49ce-aece-6a471b4609d5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1358 microversion: 2.1 time: 0.150831 Oct 03 14:53:26.273652 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 151/274] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:26 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:26.814193 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-65772fe7-8b6f-457e-becb-cfb1e055bb4c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:26.814802 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-65772fe7-8b6f-457e-becb-cfb1e055bb4c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:26.821758 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-65772fe7-8b6f-457e-becb-cfb1e055bb4c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:26.822246 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-65772fe7-8b6f-457e-becb-cfb1e055bb4c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:26.822679 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-65772fe7-8b6f-457e-becb-cfb1e055bb4c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:26.823362 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-65772fe7-8b6f-457e-becb-cfb1e055bb4c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:26.823817 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-65772fe7-8b6f-457e-becb-cfb1e055bb4c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:26.824234 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-65772fe7-8b6f-457e-becb-cfb1e055bb4c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:26.884958 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-7d26f837-ac09-4857-bc04-105790ec7be8 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:26.885526 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-7d26f837-ac09-4857-bc04-105790ec7be8 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:26.891770 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7d26f837-ac09-4857-bc04-105790ec7be8 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:26.892262 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7d26f837-ac09-4857-bc04-105790ec7be8 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:26.892692 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7d26f837-ac09-4857-bc04-105790ec7be8 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:26.893396 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7d26f837-ac09-4857-bc04-105790ec7be8 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:26.893875 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7d26f837-ac09-4857-bc04-105790ec7be8 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:26.894298 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7d26f837-ac09-4857-bc04-105790ec7be8 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:26.968715 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-65772fe7-8b6f-457e-becb-cfb1e055bb4c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:26.978167 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-65772fe7-8b6f-457e-becb-cfb1e055bb4c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1521 microversion: 2.1 time: 0.167307 Oct 03 14:53:26.979297 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 124/275] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:26 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:27.027445 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-7d26f837-ac09-4857-bc04-105790ec7be8 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc880a31f5be4ea2a500bfa504749ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3f1ef0d0c343dfbf2eae49c0ea450c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:27.036277 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-7d26f837-ac09-4857-bc04-105790ec7be8 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777" status: 200 len: 1315 microversion: 2.1 time: 0.155398 Oct 03 14:53:27.036837 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 152/276] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:26 2022] GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:27.296347 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-8b7a421b-5e83-4039-b71c-5b75844f9c36 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:27.299398 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-8b7a421b-5e83-4039-b71c-5b75844f9c36 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:27.311011 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8b7a421b-5e83-4039-b71c-5b75844f9c36 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:27.316889 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8b7a421b-5e83-4039-b71c-5b75844f9c36 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:27.317540 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8b7a421b-5e83-4039-b71c-5b75844f9c36 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:27.318485 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8b7a421b-5e83-4039-b71c-5b75844f9c36 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:27.320916 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8b7a421b-5e83-4039-b71c-5b75844f9c36 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:27.323357 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8b7a421b-5e83-4039-b71c-5b75844f9c36 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:27.514927 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-8b7a421b-5e83-4039-b71c-5b75844f9c36 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:27.525140 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-8b7a421b-5e83-4039-b71c-5b75844f9c36 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1358 microversion: 2.1 time: 0.233367 Oct 03 14:53:27.525864 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 125/277] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:27 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:28.003262 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-686421f5-9ca7-4892-825c-76c5860cd840 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:28.004610 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-686421f5-9ca7-4892-825c-76c5860cd840 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:28.013070 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-686421f5-9ca7-4892-825c-76c5860cd840 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:28.013574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-686421f5-9ca7-4892-825c-76c5860cd840 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:28.014000 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-686421f5-9ca7-4892-825c-76c5860cd840 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:28.014864 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-686421f5-9ca7-4892-825c-76c5860cd840 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:28.015324 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-686421f5-9ca7-4892-825c-76c5860cd840 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:28.015738 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-686421f5-9ca7-4892-825c-76c5860cd840 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:28.059858 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-93c8dc8e-ca20-4024-8417-c461916d9d88 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:28.060470 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-93c8dc8e-ca20-4024-8417-c461916d9d88 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:28.068103 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-93c8dc8e-ca20-4024-8417-c461916d9d88 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:28.068596 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-93c8dc8e-ca20-4024-8417-c461916d9d88 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:28.069032 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-93c8dc8e-ca20-4024-8417-c461916d9d88 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:28.069771 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-93c8dc8e-ca20-4024-8417-c461916d9d88 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:28.070232 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-93c8dc8e-ca20-4024-8417-c461916d9d88 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:28.070653 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-93c8dc8e-ca20-4024-8417-c461916d9d88 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:28.166972 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-686421f5-9ca7-4892-825c-76c5860cd840 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:28.178431 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-686421f5-9ca7-4892-825c-76c5860cd840 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1521 microversion: 2.1 time: 0.179796 Oct 03 14:53:28.179462 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 153/278] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:27 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:28.260324 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-93c8dc8e-ca20-4024-8417-c461916d9d88 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc880a31f5be4ea2a500bfa504749ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3f1ef0d0c343dfbf2eae49c0ea450c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:28.278050 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-93c8dc8e-ca20-4024-8417-c461916d9d88 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777" status: 200 len: 1315 microversion: 2.1 time: 0.219734 Oct 03 14:53:28.279243 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 126/279] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:28 2022] GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:28.549715 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-04a6869a-7185-46fe-9bbc-617049cfdd3e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:28.550417 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-04a6869a-7185-46fe-9bbc-617049cfdd3e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:28.556778 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-04a6869a-7185-46fe-9bbc-617049cfdd3e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:28.557271 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-04a6869a-7185-46fe-9bbc-617049cfdd3e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:28.557740 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-04a6869a-7185-46fe-9bbc-617049cfdd3e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:28.558436 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-04a6869a-7185-46fe-9bbc-617049cfdd3e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:28.558970 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-04a6869a-7185-46fe-9bbc-617049cfdd3e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:28.559297 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-04a6869a-7185-46fe-9bbc-617049cfdd3e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:28.690824 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-04a6869a-7185-46fe-9bbc-617049cfdd3e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:28.698537 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-04a6869a-7185-46fe-9bbc-617049cfdd3e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1358 microversion: 2.1 time: 0.153746 Oct 03 14:53:28.699148 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 154/280] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:28 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:29.201982 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-10ce6334-76f0-46fd-a987-2b4ae178c116 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:29.202592 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-10ce6334-76f0-46fd-a987-2b4ae178c116 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:29.210180 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-10ce6334-76f0-46fd-a987-2b4ae178c116 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:29.210930 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-10ce6334-76f0-46fd-a987-2b4ae178c116 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:29.211554 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-10ce6334-76f0-46fd-a987-2b4ae178c116 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:29.212409 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-10ce6334-76f0-46fd-a987-2b4ae178c116 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:29.212872 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-10ce6334-76f0-46fd-a987-2b4ae178c116 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:29.213297 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-10ce6334-76f0-46fd-a987-2b4ae178c116 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:29.305830 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-7ae8f5f4-c0c5-41f2-8cf3-b93b50db9fcf tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:29.306450 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-7ae8f5f4-c0c5-41f2-8cf3-b93b50db9fcf tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:29.319368 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7ae8f5f4-c0c5-41f2-8cf3-b93b50db9fcf tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:29.321315 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7ae8f5f4-c0c5-41f2-8cf3-b93b50db9fcf tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:29.322856 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7ae8f5f4-c0c5-41f2-8cf3-b93b50db9fcf tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:29.323679 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7ae8f5f4-c0c5-41f2-8cf3-b93b50db9fcf tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:29.324202 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7ae8f5f4-c0c5-41f2-8cf3-b93b50db9fcf tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:29.324699 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7ae8f5f4-c0c5-41f2-8cf3-b93b50db9fcf tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:29.453996 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-10ce6334-76f0-46fd-a987-2b4ae178c116 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:29.461698 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-10ce6334-76f0-46fd-a987-2b4ae178c116 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1521 microversion: 2.1 time: 0.263719 Oct 03 14:53:29.462277 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 127/281] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:29 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:29.483346 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-66e72747-3c94-41af-b649-51aa987533b7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:29.485138 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-66e72747-3c94-41af-b649-51aa987533b7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:29.488686 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-7ae8f5f4-c0c5-41f2-8cf3-b93b50db9fcf tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc880a31f5be4ea2a500bfa504749ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3f1ef0d0c343dfbf2eae49c0ea450c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:29.493184 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-66e72747-3c94-41af-b649-51aa987533b7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:29.493578 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-66e72747-3c94-41af-b649-51aa987533b7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:29.494014 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-66e72747-3c94-41af-b649-51aa987533b7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:29.495006 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-66e72747-3c94-41af-b649-51aa987533b7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:29.495457 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-66e72747-3c94-41af-b649-51aa987533b7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:29.496072 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-66e72747-3c94-41af-b649-51aa987533b7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:29.496588 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-7ae8f5f4-c0c5-41f2-8cf3-b93b50db9fcf tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777" status: 200 len: 1315 microversion: 2.1 time: 0.197038 Oct 03 14:53:29.497172 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 155/282] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:29 2022] GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:29.528547 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-66e72747-3c94-41af-b649-51aa987533b7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Going to try to terminate instance {{(pid=126852) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:53:29.626277 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-66e72747-3c94-41af-b649-51aa987533b7 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 204 len: 0 microversion: 2.1 time: 0.150391 Oct 03 14:53:29.626865 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 128/283] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 3 14:53:29 2022] DELETE /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:53:29.635022 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-efc92b89-f33b-47cd-acc2-5f37e6a7cce5 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:29.635634 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-efc92b89-f33b-47cd-acc2-5f37e6a7cce5 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:29.642134 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-efc92b89-f33b-47cd-acc2-5f37e6a7cce5 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:29.642613 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-efc92b89-f33b-47cd-acc2-5f37e6a7cce5 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:29.643041 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-efc92b89-f33b-47cd-acc2-5f37e6a7cce5 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:29.643723 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-efc92b89-f33b-47cd-acc2-5f37e6a7cce5 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:29.644175 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-efc92b89-f33b-47cd-acc2-5f37e6a7cce5 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:29.644596 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-efc92b89-f33b-47cd-acc2-5f37e6a7cce5 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:29.723324 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-cfb9e923-4b7e-4fb7-80f2-e512951a5107 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:29.724021 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-cfb9e923-4b7e-4fb7-80f2-e512951a5107 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:29.731376 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cfb9e923-4b7e-4fb7-80f2-e512951a5107 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:29.731980 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cfb9e923-4b7e-4fb7-80f2-e512951a5107 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:29.732443 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cfb9e923-4b7e-4fb7-80f2-e512951a5107 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:29.733308 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cfb9e923-4b7e-4fb7-80f2-e512951a5107 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:29.734109 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cfb9e923-4b7e-4fb7-80f2-e512951a5107 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:29.741781 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cfb9e923-4b7e-4fb7-80f2-e512951a5107 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:29.799927 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-efc92b89-f33b-47cd-acc2-5f37e6a7cce5 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:29.818603 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-efc92b89-f33b-47cd-acc2-5f37e6a7cce5 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1552 microversion: 2.1 time: 0.187484 Oct 03 14:53:29.819264 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 156/284] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:29 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1552 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:29.862885 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-ab0195e7-2405-417d-822f-436bafbc7aa1 req-2e00c381-8f79-4c8e-8b52-174c9f3130d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2b52a25-aa5a-4517-b43a-5f7648431777", "name": "network-vif-plugged", "status": "completed", "tag": "35f10418-cb11-4f70-8187-1d74218f400c"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:53:29.878510 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-ab0195e7-2405-417d-822f-436bafbc7aa1 req-2e00c381-8f79-4c8e-8b52-174c9f3130d1 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:29.878988 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-ab0195e7-2405-417d-822f-436bafbc7aa1 req-2e00c381-8f79-4c8e-8b52-174c9f3130d1 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:29.879421 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-ab0195e7-2405-417d-822f-436bafbc7aa1 req-2e00c381-8f79-4c8e-8b52-174c9f3130d1 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:29.895435 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-ab0195e7-2405-417d-822f-436bafbc7aa1 req-2e00c381-8f79-4c8e-8b52-174c9f3130d1 service nova] Creating event network-vif-plugged:35f10418-cb11-4f70-8187-1d74218f400c for instance a2b52a25-aa5a-4517-b43a-5f7648431777 on hv-cinder-85987 Oct 03 14:53:29.902932 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-ab0195e7-2405-417d-822f-436bafbc7aa1 req-2e00c381-8f79-4c8e-8b52-174c9f3130d1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045276 Oct 03 14:53:29.904410 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 157/285] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:53:29.915808 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-cfb9e923-4b7e-4fb7-80f2-e512951a5107 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:29.930850 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-cfb9e923-4b7e-4fb7-80f2-e512951a5107 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1358 microversion: 2.1 time: 0.211801 Oct 03 14:53:29.931625 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 129/286] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:29 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:30.488909 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-8d3611d3-cfec-4e63-9180-08101bc4ac2a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:30.489655 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-8d3611d3-cfec-4e63-9180-08101bc4ac2a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:30.495537 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8d3611d3-cfec-4e63-9180-08101bc4ac2a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:30.496012 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8d3611d3-cfec-4e63-9180-08101bc4ac2a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:30.496443 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8d3611d3-cfec-4e63-9180-08101bc4ac2a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:30.497128 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8d3611d3-cfec-4e63-9180-08101bc4ac2a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:30.497645 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8d3611d3-cfec-4e63-9180-08101bc4ac2a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:30.498068 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8d3611d3-cfec-4e63-9180-08101bc4ac2a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:30.520578 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-78a8a849-989b-4b2c-838d-3ac3e085d60f tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:30.521183 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-78a8a849-989b-4b2c-838d-3ac3e085d60f tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:30.527523 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-78a8a849-989b-4b2c-838d-3ac3e085d60f tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:30.527998 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-78a8a849-989b-4b2c-838d-3ac3e085d60f tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:30.528429 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-78a8a849-989b-4b2c-838d-3ac3e085d60f tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:30.529110 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-78a8a849-989b-4b2c-838d-3ac3e085d60f tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:30.529580 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-78a8a849-989b-4b2c-838d-3ac3e085d60f tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:30.530003 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-78a8a849-989b-4b2c-838d-3ac3e085d60f tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:30.624965 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-8d3611d3-cfec-4e63-9180-08101bc4ac2a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:30.633146 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-8d3611d3-cfec-4e63-9180-08101bc4ac2a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1521 microversion: 2.1 time: 0.148629 Oct 03 14:53:30.633744 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 158/287] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:30 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:30.658489 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-78a8a849-989b-4b2c-838d-3ac3e085d60f tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc880a31f5be4ea2a500bfa504749ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3f1ef0d0c343dfbf2eae49c0ea450c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:30.666014 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-78a8a849-989b-4b2c-838d-3ac3e085d60f tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777" status: 200 len: 1315 microversion: 2.1 time: 0.149720 Oct 03 14:53:30.666582 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 130/288] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:30 2022] GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:30.841127 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-99e8110e-5bd0-4e02-9dc0-96b6e8e4d749 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:30.841681 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-99e8110e-5bd0-4e02-9dc0-96b6e8e4d749 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:30.847811 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-99e8110e-5bd0-4e02-9dc0-96b6e8e4d749 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:30.848286 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-99e8110e-5bd0-4e02-9dc0-96b6e8e4d749 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:30.848712 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-99e8110e-5bd0-4e02-9dc0-96b6e8e4d749 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:30.849382 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-99e8110e-5bd0-4e02-9dc0-96b6e8e4d749 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:30.849859 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-99e8110e-5bd0-4e02-9dc0-96b6e8e4d749 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:30.850277 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-99e8110e-5bd0-4e02-9dc0-96b6e8e4d749 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:30.953062 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-b6b18c65-824d-4877-9ee0-136f2d4024f9 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:30.953852 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-b6b18c65-824d-4877-9ee0-136f2d4024f9 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:30.959652 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b6b18c65-824d-4877-9ee0-136f2d4024f9 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:30.960136 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b6b18c65-824d-4877-9ee0-136f2d4024f9 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:30.960580 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b6b18c65-824d-4877-9ee0-136f2d4024f9 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:30.961268 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b6b18c65-824d-4877-9ee0-136f2d4024f9 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:30.961749 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b6b18c65-824d-4877-9ee0-136f2d4024f9 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:30.962171 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b6b18c65-824d-4877-9ee0-136f2d4024f9 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:30.979283 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-99e8110e-5bd0-4e02-9dc0-96b6e8e4d749 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:30.988301 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-99e8110e-5bd0-4e02-9dc0-96b6e8e4d749 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1552 microversion: 2.1 time: 0.151070 Oct 03 14:53:30.988941 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 159/289] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:30 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1552 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:31.092237 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-b6b18c65-824d-4877-9ee0-136f2d4024f9 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:31.099906 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-b6b18c65-824d-4877-9ee0-136f2d4024f9 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1544 microversion: 2.1 time: 0.150598 Oct 03 14:53:31.100479 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 131/290] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:30 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1544 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:31.123662 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-7cd62ae8-997f-4a2c-b888-cf383000a85c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:31.124149 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-7cd62ae8-997f-4a2c-b888-cf383000a85c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:31.130708 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7cd62ae8-997f-4a2c-b888-cf383000a85c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:31.131196 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7cd62ae8-997f-4a2c-b888-cf383000a85c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:31.131636 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7cd62ae8-997f-4a2c-b888-cf383000a85c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:31.132321 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7cd62ae8-997f-4a2c-b888-cf383000a85c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:31.132776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7cd62ae8-997f-4a2c-b888-cf383000a85c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:31.133200 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7cd62ae8-997f-4a2c-b888-cf383000a85c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:31.207160 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-7cd62ae8-997f-4a2c-b888-cf383000a85c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087280 Oct 03 14:53:31.207779 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 160/291] 10.222.0.46 () {58 vars in 1275 bytes} [Mon Oct 3 14:53:31 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:53:31.656067 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-af36d508-eb0b-43d3-89a5-d86950b4d183 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:31.656950 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-af36d508-eb0b-43d3-89a5-d86950b4d183 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:31.664240 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-af36d508-eb0b-43d3-89a5-d86950b4d183 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:31.664722 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-af36d508-eb0b-43d3-89a5-d86950b4d183 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:31.665151 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-af36d508-eb0b-43d3-89a5-d86950b4d183 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:31.665866 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-af36d508-eb0b-43d3-89a5-d86950b4d183 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:31.666317 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-af36d508-eb0b-43d3-89a5-d86950b4d183 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:31.666737 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-af36d508-eb0b-43d3-89a5-d86950b4d183 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:31.688787 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-a056e32d-3dd0-4611-8f20-73fac025a0b2 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:31.690109 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-a056e32d-3dd0-4611-8f20-73fac025a0b2 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:31.698224 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a056e32d-3dd0-4611-8f20-73fac025a0b2 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:31.699148 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a056e32d-3dd0-4611-8f20-73fac025a0b2 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:31.699873 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a056e32d-3dd0-4611-8f20-73fac025a0b2 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:31.701111 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a056e32d-3dd0-4611-8f20-73fac025a0b2 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:31.701777 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a056e32d-3dd0-4611-8f20-73fac025a0b2 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:31.702637 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a056e32d-3dd0-4611-8f20-73fac025a0b2 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:31.834756 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-af36d508-eb0b-43d3-89a5-d86950b4d183 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:31.843045 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-af36d508-eb0b-43d3-89a5-d86950b4d183 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1521 microversion: 2.1 time: 0.190758 Oct 03 14:53:31.844414 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 132/292] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:31 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:32.011437 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-634cf483-8513-48e3-8728-28538c9caa8a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:32.013034 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-634cf483-8513-48e3-8728-28538c9caa8a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:32.019637 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-634cf483-8513-48e3-8728-28538c9caa8a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:32.020128 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-634cf483-8513-48e3-8728-28538c9caa8a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:32.020563 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-634cf483-8513-48e3-8728-28538c9caa8a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:32.021262 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-634cf483-8513-48e3-8728-28538c9caa8a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:32.022707 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-634cf483-8513-48e3-8728-28538c9caa8a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:32.022796 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-634cf483-8513-48e3-8728-28538c9caa8a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:32.225072 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-a056e32d-3dd0-4611-8f20-73fac025a0b2 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc880a31f5be4ea2a500bfa504749ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3f1ef0d0c343dfbf2eae49c0ea450c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:32.238762 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-a056e32d-3dd0-4611-8f20-73fac025a0b2 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777" status: 200 len: 1315 microversion: 2.1 time: 0.554298 Oct 03 14:53:32.239684 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 161/293] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:31 2022] GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 => generated 1315 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:32.408839 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-634cf483-8513-48e3-8728-28538c9caa8a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:32.421299 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-634cf483-8513-48e3-8728-28538c9caa8a tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1552 microversion: 2.1 time: 0.413616 Oct 03 14:53:32.422089 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 133/294] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:32 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1552 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:32.769702 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-5a6e5be4-5c48-41fa-bdcf-f27cd3cf4f64 req-2ec67547-8478-4cbf-9d77-68efb4d49536 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bac89fd1-5f09-42a7-90f2-5074c12859fc", "tag": "8e144fc1-dc68-4200-84eb-87fed3d70fcb"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:53:32.779567 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-5a6e5be4-5c48-41fa-bdcf-f27cd3cf4f64 req-2ec67547-8478-4cbf-9d77-68efb4d49536 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:32.780078 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-5a6e5be4-5c48-41fa-bdcf-f27cd3cf4f64 req-2ec67547-8478-4cbf-9d77-68efb4d49536 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:32.780507 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-5a6e5be4-5c48-41fa-bdcf-f27cd3cf4f64 req-2ec67547-8478-4cbf-9d77-68efb4d49536 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:32.792175 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-5a6e5be4-5c48-41fa-bdcf-f27cd3cf4f64 req-2ec67547-8478-4cbf-9d77-68efb4d49536 service nova] Creating event network-changed:8e144fc1-dc68-4200-84eb-87fed3d70fcb for instance bac89fd1-5f09-42a7-90f2-5074c12859fc on hv-cinder-85987 Oct 03 14:53:32.797458 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-5a6e5be4-5c48-41fa-bdcf-f27cd3cf4f64 req-2ec67547-8478-4cbf-9d77-68efb4d49536 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032041 Oct 03 14:53:32.798140 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 162/295] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:53:32.866791 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-923f9448-ab9c-46d5-b2dc-af7b06185379 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:32.867407 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-923f9448-ab9c-46d5-b2dc-af7b06185379 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:32.873237 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-923f9448-ab9c-46d5-b2dc-af7b06185379 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:32.873810 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-923f9448-ab9c-46d5-b2dc-af7b06185379 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:32.874328 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-923f9448-ab9c-46d5-b2dc-af7b06185379 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:32.875857 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-923f9448-ab9c-46d5-b2dc-af7b06185379 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:32.876309 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-923f9448-ab9c-46d5-b2dc-af7b06185379 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:32.876883 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-923f9448-ab9c-46d5-b2dc-af7b06185379 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:33.013254 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-923f9448-ab9c-46d5-b2dc-af7b06185379 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:33.021720 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-923f9448-ab9c-46d5-b2dc-af7b06185379 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1521 microversion: 2.1 time: 0.158921 Oct 03 14:53:33.022284 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 134/296] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:32 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:33.262527 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-9b4bc517-9bf0-438f-ab9a-9855efb20296 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:33.263430 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-9b4bc517-9bf0-438f-ab9a-9855efb20296 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:33.269766 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9b4bc517-9bf0-438f-ab9a-9855efb20296 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:33.270251 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9b4bc517-9bf0-438f-ab9a-9855efb20296 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:33.270684 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9b4bc517-9bf0-438f-ab9a-9855efb20296 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:33.271379 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9b4bc517-9bf0-438f-ab9a-9855efb20296 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:33.271832 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9b4bc517-9bf0-438f-ab9a-9855efb20296 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:33.272258 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9b4bc517-9bf0-438f-ab9a-9855efb20296 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:33.407845 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-9b4bc517-9bf0-438f-ab9a-9855efb20296 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc880a31f5be4ea2a500bfa504749ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3f1ef0d0c343dfbf2eae49c0ea450c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:33.415449 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-9b4bc517-9bf0-438f-ab9a-9855efb20296 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777" status: 200 len: 1315 microversion: 2.1 time: 0.157251 Oct 03 14:53:33.416024 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 163/297] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:33 2022] GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:33.444825 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-3d8719a6-7d6c-470c-9838-dc24f9339906 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:33.445427 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-3d8719a6-7d6c-470c-9838-dc24f9339906 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:33.451212 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3d8719a6-7d6c-470c-9838-dc24f9339906 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:33.451718 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3d8719a6-7d6c-470c-9838-dc24f9339906 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:33.452147 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3d8719a6-7d6c-470c-9838-dc24f9339906 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:33.452834 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3d8719a6-7d6c-470c-9838-dc24f9339906 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:33.453280 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3d8719a6-7d6c-470c-9838-dc24f9339906 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:33.453727 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3d8719a6-7d6c-470c-9838-dc24f9339906 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:33.589004 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-3d8719a6-7d6c-470c-9838-dc24f9339906 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:33.601230 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-3d8719a6-7d6c-470c-9838-dc24f9339906 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1552 microversion: 2.1 time: 0.160053 Oct 03 14:53:33.601841 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 135/298] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:33 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:34.044316 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-656354a9-4765-4db7-9aba-1d15deb02563 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:34.045010 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-656354a9-4765-4db7-9aba-1d15deb02563 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:34.051241 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-656354a9-4765-4db7-9aba-1d15deb02563 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:34.051799 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-656354a9-4765-4db7-9aba-1d15deb02563 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:34.052302 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-656354a9-4765-4db7-9aba-1d15deb02563 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:34.053248 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-656354a9-4765-4db7-9aba-1d15deb02563 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:34.053735 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-656354a9-4765-4db7-9aba-1d15deb02563 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:34.054154 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-656354a9-4765-4db7-9aba-1d15deb02563 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:34.183806 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-656354a9-4765-4db7-9aba-1d15deb02563 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:34.191909 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-656354a9-4765-4db7-9aba-1d15deb02563 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1521 microversion: 2.1 time: 0.151508 Oct 03 14:53:34.192712 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 164/299] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:34 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:34.439642 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-4f299f4e-2332-405f-b937-2ea6a4d0874d tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:34.440255 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-4f299f4e-2332-405f-b937-2ea6a4d0874d tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:34.447287 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4f299f4e-2332-405f-b937-2ea6a4d0874d tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:34.447776 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4f299f4e-2332-405f-b937-2ea6a4d0874d tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:34.448209 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4f299f4e-2332-405f-b937-2ea6a4d0874d tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:34.448917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4f299f4e-2332-405f-b937-2ea6a4d0874d tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:34.449370 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4f299f4e-2332-405f-b937-2ea6a4d0874d tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:34.449825 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4f299f4e-2332-405f-b937-2ea6a4d0874d tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:34.469102 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:34.594001 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-4f299f4e-2332-405f-b937-2ea6a4d0874d tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc880a31f5be4ea2a500bfa504749ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3f1ef0d0c343dfbf2eae49c0ea450c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:34.601601 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-4f299f4e-2332-405f-b937-2ea6a4d0874d tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777" status: 200 len: 1315 microversion: 2.1 time: 0.166303 Oct 03 14:53:34.602167 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 136/300] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:34 2022] GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:34.625925 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-03dc84a7-3fa0-4148-9320-1cef47c94e3e tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:34.626534 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-03dc84a7-3fa0-4148-9320-1cef47c94e3e tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:34.632353 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-03dc84a7-3fa0-4148-9320-1cef47c94e3e tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:34.632836 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-03dc84a7-3fa0-4148-9320-1cef47c94e3e tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:34.633265 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-03dc84a7-3fa0-4148-9320-1cef47c94e3e tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:34.633978 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-03dc84a7-3fa0-4148-9320-1cef47c94e3e tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:34.634428 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-03dc84a7-3fa0-4148-9320-1cef47c94e3e tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:34.634852 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-03dc84a7-3fa0-4148-9320-1cef47c94e3e tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:34.852856 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-03dc84a7-3fa0-4148-9320-1cef47c94e3e tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:34.862103 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-03dc84a7-3fa0-4148-9320-1cef47c94e3e tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1552 microversion: 2.1 time: 0.240687 Oct 03 14:53:34.862745 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 165/301] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:34 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1552 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:34.994254 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-5815a01f-025c-4f4c-828e-b99bc35c5816 req-ea305b4d-0516-4d00-908f-09f9868cf091 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b", "name": "network-vif-deleted", "tag": "2e72d55c-b330-49d5-9e42-f12cbb9f7a3b"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:53:35.005386 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-5815a01f-025c-4f4c-828e-b99bc35c5816 req-ea305b4d-0516-4d00-908f-09f9868cf091 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:35.006121 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-5815a01f-025c-4f4c-828e-b99bc35c5816 req-ea305b4d-0516-4d00-908f-09f9868cf091 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:35.006559 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-5815a01f-025c-4f4c-828e-b99bc35c5816 req-ea305b4d-0516-4d00-908f-09f9868cf091 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:35.019023 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-5815a01f-025c-4f4c-828e-b99bc35c5816 req-ea305b4d-0516-4d00-908f-09f9868cf091 service nova] Creating event network-vif-deleted:2e72d55c-b330-49d5-9e42-f12cbb9f7a3b for instance 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b on hv-cinder-85987 Oct 03 14:53:35.025001 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-5815a01f-025c-4f4c-828e-b99bc35c5816 req-ea305b4d-0516-4d00-908f-09f9868cf091 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034352 Oct 03 14:53:35.025898 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 137/302] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:53:35.215817 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-c02cac30-2f1a-48b5-96b3-931cf3e13633 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:35.216428 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-c02cac30-2f1a-48b5-96b3-931cf3e13633 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:35.226997 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c02cac30-2f1a-48b5-96b3-931cf3e13633 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:35.227623 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c02cac30-2f1a-48b5-96b3-931cf3e13633 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:35.228110 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c02cac30-2f1a-48b5-96b3-931cf3e13633 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:35.229131 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c02cac30-2f1a-48b5-96b3-931cf3e13633 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:35.229240 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c02cac30-2f1a-48b5-96b3-931cf3e13633 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:35.230843 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c02cac30-2f1a-48b5-96b3-931cf3e13633 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:35.365356 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-c02cac30-2f1a-48b5-96b3-931cf3e13633 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:35.374820 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-c02cac30-2f1a-48b5-96b3-931cf3e13633 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1521 microversion: 2.1 time: 0.162809 Oct 03 14:53:35.375910 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 166/303] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:35 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:35.625575 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-955d13ed-631f-40a4-ba7d-350f6ed12cda tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:35.626254 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-955d13ed-631f-40a4-ba7d-350f6ed12cda tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:35.632301 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-955d13ed-631f-40a4-ba7d-350f6ed12cda tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:35.632792 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-955d13ed-631f-40a4-ba7d-350f6ed12cda tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:35.633224 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-955d13ed-631f-40a4-ba7d-350f6ed12cda tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:35.633949 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-955d13ed-631f-40a4-ba7d-350f6ed12cda tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:35.634403 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-955d13ed-631f-40a4-ba7d-350f6ed12cda tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:35.634827 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-955d13ed-631f-40a4-ba7d-350f6ed12cda tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:35.767821 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-955d13ed-631f-40a4-ba7d-350f6ed12cda tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc880a31f5be4ea2a500bfa504749ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3f1ef0d0c343dfbf2eae49c0ea450c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:35.775666 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-955d13ed-631f-40a4-ba7d-350f6ed12cda tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777" status: 200 len: 1465 microversion: 2.1 time: 0.154986 Oct 03 14:53:35.776237 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 138/304] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:35 2022] GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 => generated 1465 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:35.833528 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-dd87a03f-e4ec-4be9-a6c6-642c97e18604 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:35.834237 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-dd87a03f-e4ec-4be9-a6c6-642c97e18604 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:35.840245 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dd87a03f-e4ec-4be9-a6c6-642c97e18604 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:35.840987 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dd87a03f-e4ec-4be9-a6c6-642c97e18604 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:35.841491 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dd87a03f-e4ec-4be9-a6c6-642c97e18604 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:35.842591 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dd87a03f-e4ec-4be9-a6c6-642c97e18604 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:35.843211 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dd87a03f-e4ec-4be9-a6c6-642c97e18604 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:35.843581 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dd87a03f-e4ec-4be9-a6c6-642c97e18604 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:35.868158 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-dd87a03f-e4ec-4be9-a6c6-642c97e18604 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Going to try to terminate instance {{(pid=126851) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:53:35.888331 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-53b27fc0-4ee1-49f4-87a2-0a1b56060bb8 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:35.889166 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-53b27fc0-4ee1-49f4-87a2-0a1b56060bb8 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:35.895775 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-53b27fc0-4ee1-49f4-87a2-0a1b56060bb8 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:35.896273 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-53b27fc0-4ee1-49f4-87a2-0a1b56060bb8 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:35.896711 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-53b27fc0-4ee1-49f4-87a2-0a1b56060bb8 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:35.897554 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-53b27fc0-4ee1-49f4-87a2-0a1b56060bb8 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:35.898017 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-53b27fc0-4ee1-49f4-87a2-0a1b56060bb8 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:35.898494 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-53b27fc0-4ee1-49f4-87a2-0a1b56060bb8 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:35.954757 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-dd87a03f-e4ec-4be9-a6c6-642c97e18604 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777" status: 204 len: 0 microversion: 2.1 time: 0.124747 Oct 03 14:53:35.955350 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 167/305] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 3 14:53:35 2022] DELETE /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 14:53:35.963883 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-877fb665-4319-4db6-9e38-ec48f151ae19 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:35.964610 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-877fb665-4319-4db6-9e38-ec48f151ae19 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:35.970710 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-877fb665-4319-4db6-9e38-ec48f151ae19 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:35.971200 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-877fb665-4319-4db6-9e38-ec48f151ae19 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:35.971633 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-877fb665-4319-4db6-9e38-ec48f151ae19 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:35.972329 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-877fb665-4319-4db6-9e38-ec48f151ae19 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:35.972797 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-877fb665-4319-4db6-9e38-ec48f151ae19 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:35.973206 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-877fb665-4319-4db6-9e38-ec48f151ae19 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:35.974366 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-53b27fc0-4ee1-49f4-87a2-0a1b56060bb8 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:35.986856 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-53b27fc0-4ee1-49f4-87a2-0a1b56060bb8 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1345 microversion: 2.1 time: 0.103517 Oct 03 14:53:35.987809 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 139/306] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:35 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1345 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:36.126587 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:36.234114 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-877fb665-4319-4db6-9e38-ec48f151ae19 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc880a31f5be4ea2a500bfa504749ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3f1ef0d0c343dfbf2eae49c0ea450c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:36.242091 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-877fb665-4319-4db6-9e38-ec48f151ae19 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777" status: 200 len: 1471 microversion: 2.1 time: 0.282141 Oct 03 14:53:36.242647 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 168/307] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:35 2022] GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 => generated 1471 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:36.402192 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-3ccdaec0-ee88-4a54-8b82-7097faf7bae1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:36.403045 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-3ccdaec0-ee88-4a54-8b82-7097faf7bae1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:36.409996 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3ccdaec0-ee88-4a54-8b82-7097faf7bae1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:36.410568 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3ccdaec0-ee88-4a54-8b82-7097faf7bae1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:36.411098 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3ccdaec0-ee88-4a54-8b82-7097faf7bae1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:36.411896 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3ccdaec0-ee88-4a54-8b82-7097faf7bae1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:36.412407 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3ccdaec0-ee88-4a54-8b82-7097faf7bae1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:36.412907 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3ccdaec0-ee88-4a54-8b82-7097faf7bae1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:36.548317 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-3ccdaec0-ee88-4a54-8b82-7097faf7bae1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:36.556183 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-3ccdaec0-ee88-4a54-8b82-7097faf7bae1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1521 microversion: 2.1 time: 0.161520 Oct 03 14:53:36.557000 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 140/308] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:36 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:37.010735 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-6befca31-b7b6-4967-a5b6-9e420ea82bea tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:37.011401 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-6befca31-b7b6-4967-a5b6-9e420ea82bea tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:37.017524 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6befca31-b7b6-4967-a5b6-9e420ea82bea tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:37.018033 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6befca31-b7b6-4967-a5b6-9e420ea82bea tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:37.018472 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6befca31-b7b6-4967-a5b6-9e420ea82bea tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:37.019201 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6befca31-b7b6-4967-a5b6-9e420ea82bea tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:37.019656 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6befca31-b7b6-4967-a5b6-9e420ea82bea tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:37.020082 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6befca31-b7b6-4967-a5b6-9e420ea82bea tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:37.050413 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6befca31-b7b6-4967-a5b6-9e420ea82bea tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:37.050894 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6befca31-b7b6-4967-a5b6-9e420ea82bea tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:37.051322 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6befca31-b7b6-4967-a5b6-9e420ea82bea tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:37.051772 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.objects.instance [None req-6befca31-b7b6-4967-a5b6-9e420ea82bea tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lazy-loading 'fault' on Instance uuid 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b {{(pid=126851) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:53:37.094765 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-6befca31-b7b6-4967-a5b6-9e420ea82bea tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:37.102838 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-6befca31-b7b6-4967-a5b6-9e420ea82bea tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1350 microversion: 2.1 time: 0.096010 Oct 03 14:53:37.103408 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 169/309] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:37 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1350 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:37.266178 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-83170ac7-53a7-4a43-bd9b-6658ecd1dc79 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:37.266864 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-83170ac7-53a7-4a43-bd9b-6658ecd1dc79 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:37.273192 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-83170ac7-53a7-4a43-bd9b-6658ecd1dc79 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:37.273741 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-83170ac7-53a7-4a43-bd9b-6658ecd1dc79 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:37.274177 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-83170ac7-53a7-4a43-bd9b-6658ecd1dc79 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:37.274869 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-83170ac7-53a7-4a43-bd9b-6658ecd1dc79 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:37.275325 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-83170ac7-53a7-4a43-bd9b-6658ecd1dc79 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:37.275820 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-83170ac7-53a7-4a43-bd9b-6658ecd1dc79 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:37.423934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-83170ac7-53a7-4a43-bd9b-6658ecd1dc79 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc880a31f5be4ea2a500bfa504749ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3f1ef0d0c343dfbf2eae49c0ea450c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:37.433101 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-83170ac7-53a7-4a43-bd9b-6658ecd1dc79 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777" status: 200 len: 1471 microversion: 2.1 time: 0.171295 Oct 03 14:53:37.433794 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 141/310] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:37 2022] GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 => generated 1471 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:37.579918 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-57a3e839-04bc-4665-80c4-f3f6354f0a5e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:37.580534 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-57a3e839-04bc-4665-80c4-f3f6354f0a5e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:37.586900 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-57a3e839-04bc-4665-80c4-f3f6354f0a5e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:37.587395 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-57a3e839-04bc-4665-80c4-f3f6354f0a5e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:37.587826 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-57a3e839-04bc-4665-80c4-f3f6354f0a5e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:37.588520 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-57a3e839-04bc-4665-80c4-f3f6354f0a5e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:37.589009 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-57a3e839-04bc-4665-80c4-f3f6354f0a5e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:37.589602 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-57a3e839-04bc-4665-80c4-f3f6354f0a5e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:37.737394 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-57a3e839-04bc-4665-80c4-f3f6354f0a5e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:37.746529 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-57a3e839-04bc-4665-80c4-f3f6354f0a5e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1521 microversion: 2.1 time: 0.171016 Oct 03 14:53:37.747307 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 170/311] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:37 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:38.128138 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-274249a5-386e-43a2-9eb6-f95345e0764d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:38.128736 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-274249a5-386e-43a2-9eb6-f95345e0764d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:38.134790 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-274249a5-386e-43a2-9eb6-f95345e0764d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:38.135341 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-274249a5-386e-43a2-9eb6-f95345e0764d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:38.135775 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-274249a5-386e-43a2-9eb6-f95345e0764d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:38.136468 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-274249a5-386e-43a2-9eb6-f95345e0764d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:38.136919 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-274249a5-386e-43a2-9eb6-f95345e0764d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:38.137365 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-274249a5-386e-43a2-9eb6-f95345e0764d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:38.167787 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-274249a5-386e-43a2-9eb6-f95345e0764d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:38.168269 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-274249a5-386e-43a2-9eb6-f95345e0764d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:38.168704 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-274249a5-386e-43a2-9eb6-f95345e0764d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:38.169161 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.objects.instance [None req-274249a5-386e-43a2-9eb6-f95345e0764d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lazy-loading 'fault' on Instance uuid 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b {{(pid=126852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:53:38.218142 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-274249a5-386e-43a2-9eb6-f95345e0764d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913c969eb6274750aef880400a74e637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3b8c8420474d9397a3578350b9eacf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:38.227152 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-274249a5-386e-43a2-9eb6-f95345e0764d tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 200 len: 1350 microversion: 2.1 time: 0.102884 Oct 03 14:53:38.227743 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 142/312] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:38 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 1350 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:38.462506 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-53fa33a9-f7b7-49c2-9165-0a05ac95f4fd tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:38.463120 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-53fa33a9-f7b7-49c2-9165-0a05ac95f4fd tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:38.470473 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-53fa33a9-f7b7-49c2-9165-0a05ac95f4fd tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:38.470963 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-53fa33a9-f7b7-49c2-9165-0a05ac95f4fd tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:38.471391 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-53fa33a9-f7b7-49c2-9165-0a05ac95f4fd tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:38.472300 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-53fa33a9-f7b7-49c2-9165-0a05ac95f4fd tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:38.473073 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-53fa33a9-f7b7-49c2-9165-0a05ac95f4fd tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:38.473670 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-53fa33a9-f7b7-49c2-9165-0a05ac95f4fd tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:38.621240 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-53fa33a9-f7b7-49c2-9165-0a05ac95f4fd tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc880a31f5be4ea2a500bfa504749ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3f1ef0d0c343dfbf2eae49c0ea450c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:38.629884 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-53fa33a9-f7b7-49c2-9165-0a05ac95f4fd tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777" status: 200 len: 1471 microversion: 2.1 time: 0.174509 Oct 03 14:53:38.645659 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 171/313] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:38 2022] GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 => generated 1471 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:38.770874 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-87e50673-293d-40c6-8d3d-5703c1c570ef tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:38.771677 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-87e50673-293d-40c6-8d3d-5703c1c570ef tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:38.778372 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-87e50673-293d-40c6-8d3d-5703c1c570ef tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:38.778855 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-87e50673-293d-40c6-8d3d-5703c1c570ef tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:38.779291 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-87e50673-293d-40c6-8d3d-5703c1c570ef tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:38.780212 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-87e50673-293d-40c6-8d3d-5703c1c570ef tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:38.780674 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-87e50673-293d-40c6-8d3d-5703c1c570ef tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:38.781228 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-87e50673-293d-40c6-8d3d-5703c1c570ef tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:39.057311 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-87e50673-293d-40c6-8d3d-5703c1c570ef tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:39.066123 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-87e50673-293d-40c6-8d3d-5703c1c570ef tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1521 microversion: 2.1 time: 0.299245 Oct 03 14:53:39.066766 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 143/314] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:38 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:39.203088 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-eb0462d1-f0da-4979-84b5-54808bfefa5f req-22c36993-c2fe-41df-a36f-62f8e1491a13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2b52a25-aa5a-4517-b43a-5f7648431777", "name": "network-vif-deleted", "tag": "35f10418-cb11-4f70-8187-1d74218f400c"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:53:39.209361 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:39.215994 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-eb0462d1-f0da-4979-84b5-54808bfefa5f req-22c36993-c2fe-41df-a36f-62f8e1491a13 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:39.216661 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-eb0462d1-f0da-4979-84b5-54808bfefa5f req-22c36993-c2fe-41df-a36f-62f8e1491a13 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:39.217376 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-eb0462d1-f0da-4979-84b5-54808bfefa5f req-22c36993-c2fe-41df-a36f-62f8e1491a13 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:39.239404 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-eb0462d1-f0da-4979-84b5-54808bfefa5f req-22c36993-c2fe-41df-a36f-62f8e1491a13 service nova] Creating event network-vif-deleted:35f10418-cb11-4f70-8187-1d74218f400c for instance a2b52a25-aa5a-4517-b43a-5f7648431777 on hv-cinder-85987 Oct 03 14:53:39.252112 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-dd71e5d7-1d79-41fa-b72a-d7a7bf7fdeff tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:39.252737 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-dd71e5d7-1d79-41fa-b72a-d7a7bf7fdeff tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:39.257665 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-eb0462d1-f0da-4979-84b5-54808bfefa5f req-22c36993-c2fe-41df-a36f-62f8e1491a13 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059619 Oct 03 14:53:39.258269 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 172/315] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:53:39.262050 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-dd71e5d7-1d79-41fa-b72a-d7a7bf7fdeff tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:39.262746 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-dd71e5d7-1d79-41fa-b72a-d7a7bf7fdeff tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:39.263193 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-dd71e5d7-1d79-41fa-b72a-d7a7bf7fdeff tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:39.263918 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-dd71e5d7-1d79-41fa-b72a-d7a7bf7fdeff tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:39.264382 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-dd71e5d7-1d79-41fa-b72a-d7a7bf7fdeff tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:39.264820 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-dd71e5d7-1d79-41fa-b72a-d7a7bf7fdeff tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:39.278969 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.wsgi [None req-dd71e5d7-1d79-41fa-b72a-d7a7bf7fdeff tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] HTTP exception thrown: Instance 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b could not be found. Oct 03 14:53:39.292421 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-dd71e5d7-1d79-41fa-b72a-d7a7bf7fdeff tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Request method failure captured: Oct 03 14:53:39.292421 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: request: GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b HTTP/1.1 Oct 03 14:53:39.292421 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept: application/json Oct 03 14:53:39.292421 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept-Encoding: identity Oct 03 14:53:39.292421 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Connection: close Oct 03 14:53:39.292421 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Length: 0 Oct 03 14:53:39.292421 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Type: application/json Oct 03 14:53:39.292421 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Host: 10.222.0.46 Oct 03 14:53:39.292421 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Openstack-System-Scope: None Oct 03 14:53:39.292421 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: User-Agent: python-urllib3/1.26.12 Oct 03 14:53:39.292421 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Auth-Token: gAAAAABjOvcUr3M3-xV8_4JnNfiGCL6EXehU6NQJvjKsj1gkbG8OrOvXGcYe92GESZCFXw7_dwv3iihAC3P7fATRRz5kEgzRcP6De44KzbT2FvikJeF_8UW7g5nQGCw6nhjvxdlXPiDLLa1F_mjfCQ452qdlTB_5nIx0d3vJ0bnnPQZ7JRWyKy0 Oct 03 14:53:39.292421 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Id: None Oct 03 14:53:39.292421 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Name: None Oct 03 14:53:39.292421 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Identity-Status: Confirmed Oct 03 14:53:39.292421 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Is-Admin-Project: True Oct 03 14:53:39.292421 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Id: default Oct 03 14:53:39.292421 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Name: Default Oct 03 14:53:39.292421 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Id: 2e3b8c8420474d9397a3578350b9eacf Oct 03 14:53:39.292421 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Name: tempest-DeleteServersTestJSON-2104585316 Oct 03 14:53:39.292421 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Role: member,reader Oct 03 14:53:39.292421 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Roles: member,reader Oct 03 14:53:39.293780 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e3b8c8420474d9397a3578350b9eacf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2e3b8c8420474d9397a3578350b9eacf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e3b8c8420474d9397a3578350b9eacf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2e3b8c8420474d9397a3578350b9eacf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 14:53:39.293780 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant: tempest-DeleteServersTestJSON-2104585316 Oct 03 14:53:39.293780 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Id: 2e3b8c8420474d9397a3578350b9eacf Oct 03 14:53:39.293780 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Name: tempest-DeleteServersTestJSON-2104585316 Oct 03 14:53:39.293780 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User: tempest-DeleteServersTestJSON-2104585316-project Oct 03 14:53:39.293780 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Id: default Oct 03 14:53:39.293780 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Name: Default Oct 03 14:53:39.293780 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Id: 913c969eb6274750aef880400a74e637 Oct 03 14:53:39.293780 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Name: tempest-DeleteServersTestJSON-2104585316-project Oct 03 14:53:39.293780 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: method: > Oct 03 14:53:39.293780 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: exception: Instance 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b could not be found. Oct 03 14:53:39.293780 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: action_args: {'id': '6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b'} Oct 03 14:53:39.294472 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:53:39.294472 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:39.294472 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:53:39.294472 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:53:39.294472 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:53:39.294472 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:53:39.294472 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:53:39.294472 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:53:39.294472 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:53:39.294472 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:53:39.294472 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b could not be found. Oct 03 14:53:39.294472 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:53:39.294472 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:53:39.294472 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:53:39.294472 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:39.294472 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:53:39.294472 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:53:39.294472 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:53:39.294472 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:53:39.294472 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:53:39.295534 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:53:39.295534 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:53:39.295534 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:53:39.295534 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:53:39.295534 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:53:39.295534 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:53:39.295534 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:53:39.295534 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b could not be found. Oct 03 14:53:39.295534 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:53:39.295534 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:53:39.295534 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:53:39.295534 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:39.295534 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:53:39.295534 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:53:39.295534 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:53:39.295534 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:53:39.295534 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b could not be found. Oct 03 14:53:39.295534 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:53:39.300153 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-dd71e5d7-1d79-41fa-b72a-d7a7bf7fdeff tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Returning 404 to user: Instance 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b could not be found. {{(pid=126852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:53:39.300981 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-dd71e5d7-1d79-41fa-b72a-d7a7bf7fdeff tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 404 len: 111 microversion: 2.1 time: 0.053516 Oct 03 14:53:39.302134 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 144/316] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:39 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:53:39.435439 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-753d7d3f-1324-4501-9368-19ebe1c11677 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:39.438468 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-753d7d3f-1324-4501-9368-19ebe1c11677 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:39.444831 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-753d7d3f-1324-4501-9368-19ebe1c11677 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:39.445313 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-753d7d3f-1324-4501-9368-19ebe1c11677 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:39.445769 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-753d7d3f-1324-4501-9368-19ebe1c11677 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:39.446461 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-753d7d3f-1324-4501-9368-19ebe1c11677 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:39.446918 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-753d7d3f-1324-4501-9368-19ebe1c11677 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:39.447459 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-753d7d3f-1324-4501-9368-19ebe1c11677 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:39.460678 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.wsgi [None req-753d7d3f-1324-4501-9368-19ebe1c11677 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] HTTP exception thrown: Instance 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b could not be found. Oct 03 14:53:39.464739 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-753d7d3f-1324-4501-9368-19ebe1c11677 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Request method failure captured: Oct 03 14:53:39.464739 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: request: GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b/os-volume_attachments HTTP/1.1 Oct 03 14:53:39.464739 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept: application/json Oct 03 14:53:39.464739 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept-Encoding: identity Oct 03 14:53:39.464739 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Connection: close Oct 03 14:53:39.464739 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Length: 0 Oct 03 14:53:39.464739 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Type: application/json Oct 03 14:53:39.464739 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Host: 10.222.0.46 Oct 03 14:53:39.464739 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Openstack-System-Scope: None Oct 03 14:53:39.464739 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: User-Agent: python-urllib3/1.26.12 Oct 03 14:53:39.464739 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Auth-Token: gAAAAABjOvcUr3M3-xV8_4JnNfiGCL6EXehU6NQJvjKsj1gkbG8OrOvXGcYe92GESZCFXw7_dwv3iihAC3P7fATRRz5kEgzRcP6De44KzbT2FvikJeF_8UW7g5nQGCw6nhjvxdlXPiDLLa1F_mjfCQ452qdlTB_5nIx0d3vJ0bnnPQZ7JRWyKy0 Oct 03 14:53:39.464739 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Id: None Oct 03 14:53:39.464739 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Name: None Oct 03 14:53:39.464739 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Identity-Status: Confirmed Oct 03 14:53:39.464739 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Is-Admin-Project: True Oct 03 14:53:39.464739 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Id: default Oct 03 14:53:39.464739 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Name: Default Oct 03 14:53:39.464739 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Id: 2e3b8c8420474d9397a3578350b9eacf Oct 03 14:53:39.464739 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Name: tempest-DeleteServersTestJSON-2104585316 Oct 03 14:53:39.464739 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Role: member,reader Oct 03 14:53:39.464739 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Roles: member,reader Oct 03 14:53:39.466199 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e3b8c8420474d9397a3578350b9eacf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2e3b8c8420474d9397a3578350b9eacf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e3b8c8420474d9397a3578350b9eacf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2e3b8c8420474d9397a3578350b9eacf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 14:53:39.466199 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant: tempest-DeleteServersTestJSON-2104585316 Oct 03 14:53:39.466199 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Id: 2e3b8c8420474d9397a3578350b9eacf Oct 03 14:53:39.466199 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Name: tempest-DeleteServersTestJSON-2104585316 Oct 03 14:53:39.466199 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User: tempest-DeleteServersTestJSON-2104585316-project Oct 03 14:53:39.466199 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Id: default Oct 03 14:53:39.466199 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Name: Default Oct 03 14:53:39.466199 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Id: 913c969eb6274750aef880400a74e637 Oct 03 14:53:39.466199 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Name: tempest-DeleteServersTestJSON-2104585316-project Oct 03 14:53:39.466199 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: method: > Oct 03 14:53:39.466199 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: exception: Instance 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b could not be found. Oct 03 14:53:39.466199 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: action_args: {'server_id': '6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b'} Oct 03 14:53:39.470631 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:53:39.470631 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:39.470631 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:53:39.470631 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:53:39.470631 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:53:39.470631 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:53:39.470631 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:53:39.470631 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:53:39.470631 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:53:39.470631 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:53:39.470631 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b could not be found. Oct 03 14:53:39.470631 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:53:39.470631 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:53:39.470631 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:53:39.470631 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:39.470631 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:53:39.470631 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:53:39.470631 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:53:39.470631 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:53:39.470631 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:53:39.471776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:53:39.471776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 14:53:39.471776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:53:39.471776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 14:53:39.471776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:53:39.471776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 03 14:53:39.471776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 03 14:53:39.471776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:53:39.471776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:53:39.471776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b could not be found. Oct 03 14:53:39.471776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:53:39.471776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:53:39.471776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:53:39.471776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:39.471776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:53:39.471776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:53:39.471776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:53:39.471776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:53:39.471776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b could not be found. Oct 03 14:53:39.471776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:53:39.472954 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-753d7d3f-1324-4501-9368-19ebe1c11677 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Returning 404 to user: Instance 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b could not be found. {{(pid=126851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:53:39.472954 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-753d7d3f-1324-4501-9368-19ebe1c11677 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035131 Oct 03 14:53:39.472954 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 173/317] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 3 14:53:39 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 14:53:39.652557 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-7438be08-ff1f-4f7c-aff4-7be5d3fdc9a6 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:39.653271 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-7438be08-ff1f-4f7c-aff4-7be5d3fdc9a6 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:39.660088 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7438be08-ff1f-4f7c-aff4-7be5d3fdc9a6 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:39.660659 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7438be08-ff1f-4f7c-aff4-7be5d3fdc9a6 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:39.661165 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7438be08-ff1f-4f7c-aff4-7be5d3fdc9a6 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:39.661965 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7438be08-ff1f-4f7c-aff4-7be5d3fdc9a6 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:39.662489 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7438be08-ff1f-4f7c-aff4-7be5d3fdc9a6 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:39.662908 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7438be08-ff1f-4f7c-aff4-7be5d3fdc9a6 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:39.699150 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7438be08-ff1f-4f7c-aff4-7be5d3fdc9a6 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:39.699645 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7438be08-ff1f-4f7c-aff4-7be5d3fdc9a6 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:39.700081 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7438be08-ff1f-4f7c-aff4-7be5d3fdc9a6 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:39.700523 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.objects.instance [None req-7438be08-ff1f-4f7c-aff4-7be5d3fdc9a6 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lazy-loading 'fault' on Instance uuid a2b52a25-aa5a-4517-b43a-5f7648431777 {{(pid=126852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:53:39.745556 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-7438be08-ff1f-4f7c-aff4-7be5d3fdc9a6 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc880a31f5be4ea2a500bfa504749ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3f1ef0d0c343dfbf2eae49c0ea450c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:39.753313 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-7438be08-ff1f-4f7c-aff4-7be5d3fdc9a6 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777" status: 200 len: 1305 microversion: 2.1 time: 0.104972 Oct 03 14:53:39.753906 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 145/318] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:39 2022] GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 => generated 1305 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:40.090881 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-77936402-97f1-43fa-b0b1-c2adcd08fc12 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:40.091508 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-77936402-97f1-43fa-b0b1-c2adcd08fc12 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:40.099351 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-77936402-97f1-43fa-b0b1-c2adcd08fc12 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:40.099833 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-77936402-97f1-43fa-b0b1-c2adcd08fc12 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:40.100458 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-77936402-97f1-43fa-b0b1-c2adcd08fc12 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:40.101163 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-77936402-97f1-43fa-b0b1-c2adcd08fc12 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:40.101895 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-77936402-97f1-43fa-b0b1-c2adcd08fc12 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:40.102521 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-77936402-97f1-43fa-b0b1-c2adcd08fc12 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:40.250966 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-77936402-97f1-43fa-b0b1-c2adcd08fc12 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:40.258635 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-77936402-97f1-43fa-b0b1-c2adcd08fc12 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1521 microversion: 2.1 time: 0.171857 Oct 03 14:53:40.259186 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 174/319] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:40 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:40.719788 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-bcc6f95b-08d1-48ae-a570-9fe13e9c3f3b tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:40.720290 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-bcc6f95b-08d1-48ae-a570-9fe13e9c3f3b tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:40.726683 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bcc6f95b-08d1-48ae-a570-9fe13e9c3f3b tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:40.727167 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bcc6f95b-08d1-48ae-a570-9fe13e9c3f3b tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:40.727602 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bcc6f95b-08d1-48ae-a570-9fe13e9c3f3b tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:40.728292 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bcc6f95b-08d1-48ae-a570-9fe13e9c3f3b tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:40.728747 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bcc6f95b-08d1-48ae-a570-9fe13e9c3f3b tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:40.729173 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bcc6f95b-08d1-48ae-a570-9fe13e9c3f3b tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:40.742815 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.wsgi [None req-bcc6f95b-08d1-48ae-a570-9fe13e9c3f3b tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] HTTP exception thrown: Instance 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b could not be found. Oct 03 14:53:40.744333 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-bcc6f95b-08d1-48ae-a570-9fe13e9c3f3b tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Request method failure captured: Oct 03 14:53:40.744333 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: request: DELETE /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b HTTP/1.1 Oct 03 14:53:40.744333 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept: application/json Oct 03 14:53:40.744333 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept-Encoding: identity Oct 03 14:53:40.744333 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Connection: close Oct 03 14:53:40.744333 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Length: 0 Oct 03 14:53:40.744333 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Type: application/json Oct 03 14:53:40.744333 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Host: 10.222.0.46 Oct 03 14:53:40.744333 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Openstack-System-Scope: None Oct 03 14:53:40.744333 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: User-Agent: python-urllib3/1.26.12 Oct 03 14:53:40.744333 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Auth-Token: gAAAAABjOvcUr3M3-xV8_4JnNfiGCL6EXehU6NQJvjKsj1gkbG8OrOvXGcYe92GESZCFXw7_dwv3iihAC3P7fATRRz5kEgzRcP6De44KzbT2FvikJeF_8UW7g5nQGCw6nhjvxdlXPiDLLa1F_mjfCQ452qdlTB_5nIx0d3vJ0bnnPQZ7JRWyKy0 Oct 03 14:53:40.744333 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Id: None Oct 03 14:53:40.744333 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Name: None Oct 03 14:53:40.744333 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Identity-Status: Confirmed Oct 03 14:53:40.744333 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Is-Admin-Project: True Oct 03 14:53:40.744333 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Id: default Oct 03 14:53:40.744333 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Name: Default Oct 03 14:53:40.744333 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Id: 2e3b8c8420474d9397a3578350b9eacf Oct 03 14:53:40.744333 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Name: tempest-DeleteServersTestJSON-2104585316 Oct 03 14:53:40.744333 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Role: member,reader Oct 03 14:53:40.744333 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Roles: member,reader Oct 03 14:53:40.745746 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e3b8c8420474d9397a3578350b9eacf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2e3b8c8420474d9397a3578350b9eacf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e3b8c8420474d9397a3578350b9eacf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2e3b8c8420474d9397a3578350b9eacf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 14:53:40.745746 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant: tempest-DeleteServersTestJSON-2104585316 Oct 03 14:53:40.745746 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Id: 2e3b8c8420474d9397a3578350b9eacf Oct 03 14:53:40.745746 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Name: tempest-DeleteServersTestJSON-2104585316 Oct 03 14:53:40.745746 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User: tempest-DeleteServersTestJSON-2104585316-project Oct 03 14:53:40.745746 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Id: default Oct 03 14:53:40.745746 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Name: Default Oct 03 14:53:40.745746 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Id: 913c969eb6274750aef880400a74e637 Oct 03 14:53:40.745746 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Name: tempest-DeleteServersTestJSON-2104585316-project Oct 03 14:53:40.745746 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: method: > Oct 03 14:53:40.745746 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: exception: Instance 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b could not be found. Oct 03 14:53:40.745746 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: action_args: {'id': '6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b'} Oct 03 14:53:40.746482 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:53:40.746482 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:40.746482 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:53:40.746482 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:53:40.746482 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:53:40.746482 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:53:40.746482 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:53:40.746482 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:53:40.746482 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:53:40.746482 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:53:40.746482 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b could not be found. Oct 03 14:53:40.746482 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:53:40.746482 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:53:40.746482 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:53:40.746482 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:40.746482 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:53:40.746482 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:53:40.746482 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:53:40.746482 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:53:40.746482 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:53:40.747523 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:53:40.747523 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:53:40.747523 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:53:40.747523 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:53:40.747523 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:53:40.747523 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:53:40.747523 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:53:40.747523 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:53:40.747523 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:53:40.747523 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b could not be found. Oct 03 14:53:40.747523 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:53:40.747523 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:53:40.747523 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:53:40.747523 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:40.747523 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:53:40.747523 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:53:40.747523 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:53:40.747523 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:53:40.747523 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b could not be found. Oct 03 14:53:40.747523 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:53:40.748546 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-bcc6f95b-08d1-48ae-a570-9fe13e9c3f3b tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Returning 404 to user: Instance 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b could not be found. {{(pid=126852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:53:40.748546 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-bcc6f95b-08d1-48ae-a570-9fe13e9c3f3b tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 404 len: 111 microversion: 2.1 time: 0.030033 Oct 03 14:53:40.748546 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 146/320] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 3 14:53:40 2022] DELETE /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:53:40.754531 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-dc1c53ce-9dec-4182-ab6b-75ee5da28850 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:40.755174 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-dc1c53ce-9dec-4182-ab6b-75ee5da28850 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] [instance: 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:40.761003 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dc1c53ce-9dec-4182-ab6b-75ee5da28850 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:40.761484 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dc1c53ce-9dec-4182-ab6b-75ee5da28850 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:40.761955 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dc1c53ce-9dec-4182-ab6b-75ee5da28850 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:40.762642 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dc1c53ce-9dec-4182-ab6b-75ee5da28850 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:40.763100 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dc1c53ce-9dec-4182-ab6b-75ee5da28850 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:40.763525 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dc1c53ce-9dec-4182-ab6b-75ee5da28850 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:40.775940 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-b453d811-4500-4033-8177-e7ee10b6d798 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:40.776574 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-b453d811-4500-4033-8177-e7ee10b6d798 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] [instance: a2b52a25-aa5a-4517-b43a-5f7648431777] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:40.776694 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.wsgi [None req-dc1c53ce-9dec-4182-ab6b-75ee5da28850 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] HTTP exception thrown: Instance 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b could not be found. Oct 03 14:53:40.778820 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-dc1c53ce-9dec-4182-ab6b-75ee5da28850 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Request method failure captured: Oct 03 14:53:40.778820 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: request: GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b HTTP/1.1 Oct 03 14:53:40.778820 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept: application/json Oct 03 14:53:40.778820 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept-Encoding: identity Oct 03 14:53:40.778820 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Connection: close Oct 03 14:53:40.778820 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Length: 0 Oct 03 14:53:40.778820 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Type: application/json Oct 03 14:53:40.778820 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Host: 10.222.0.46 Oct 03 14:53:40.778820 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Openstack-System-Scope: None Oct 03 14:53:40.778820 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: User-Agent: python-urllib3/1.26.12 Oct 03 14:53:40.778820 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Auth-Token: gAAAAABjOvcUr3M3-xV8_4JnNfiGCL6EXehU6NQJvjKsj1gkbG8OrOvXGcYe92GESZCFXw7_dwv3iihAC3P7fATRRz5kEgzRcP6De44KzbT2FvikJeF_8UW7g5nQGCw6nhjvxdlXPiDLLa1F_mjfCQ452qdlTB_5nIx0d3vJ0bnnPQZ7JRWyKy0 Oct 03 14:53:40.778820 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Id: None Oct 03 14:53:40.778820 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Name: None Oct 03 14:53:40.778820 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Identity-Status: Confirmed Oct 03 14:53:40.778820 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Is-Admin-Project: True Oct 03 14:53:40.778820 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Id: default Oct 03 14:53:40.778820 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Name: Default Oct 03 14:53:40.778820 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Id: 2e3b8c8420474d9397a3578350b9eacf Oct 03 14:53:40.778820 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Name: tempest-DeleteServersTestJSON-2104585316 Oct 03 14:53:40.778820 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Role: member,reader Oct 03 14:53:40.778820 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Roles: member,reader Oct 03 14:53:40.779930 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e3b8c8420474d9397a3578350b9eacf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2e3b8c8420474d9397a3578350b9eacf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e3b8c8420474d9397a3578350b9eacf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2e3b8c8420474d9397a3578350b9eacf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 14:53:40.779930 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant: tempest-DeleteServersTestJSON-2104585316 Oct 03 14:53:40.779930 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Id: 2e3b8c8420474d9397a3578350b9eacf Oct 03 14:53:40.779930 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Name: tempest-DeleteServersTestJSON-2104585316 Oct 03 14:53:40.779930 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User: tempest-DeleteServersTestJSON-2104585316-project Oct 03 14:53:40.779930 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Id: default Oct 03 14:53:40.779930 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Name: Default Oct 03 14:53:40.779930 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Id: 913c969eb6274750aef880400a74e637 Oct 03 14:53:40.779930 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Name: tempest-DeleteServersTestJSON-2104585316-project Oct 03 14:53:40.779930 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: method: > Oct 03 14:53:40.779930 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: exception: Instance 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b could not be found. Oct 03 14:53:40.779930 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: action_args: {'id': '6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b'} Oct 03 14:53:40.780555 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:53:40.780555 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:40.780555 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:53:40.780555 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:53:40.780555 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:53:40.780555 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:53:40.780555 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:53:40.780555 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:53:40.780555 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:53:40.780555 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:53:40.780555 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b could not be found. Oct 03 14:53:40.780555 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:53:40.780555 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:53:40.780555 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:53:40.780555 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:40.780555 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:53:40.780555 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:53:40.780555 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:53:40.780555 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:53:40.780555 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:53:40.782014 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:53:40.782014 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:53:40.782014 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:53:40.782014 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:53:40.782014 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:53:40.782014 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:53:40.782014 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:53:40.782014 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b could not be found. Oct 03 14:53:40.782014 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:53:40.782014 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:53:40.782014 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:53:40.782014 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:40.782014 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:53:40.782014 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:53:40.782014 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:53:40.782014 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:53:40.782014 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b could not be found. Oct 03 14:53:40.782014 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:53:40.782972 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-dc1c53ce-9dec-4182-ab6b-75ee5da28850 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] Returning 404 to user: Instance 6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b could not be found. {{(pid=126851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:53:40.782972 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-dc1c53ce-9dec-4182-ab6b-75ee5da28850 tempest-DeleteServersTestJSON-2104585316 tempest-DeleteServersTestJSON-2104585316-project] 10.222.0.46 "GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b" status: 404 len: 111 microversion: 2.1 time: 0.029490 Oct 03 14:53:40.782972 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 175/321] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:40 2022] GET /compute/v2.1/servers/6f1d4c44-bc3b-4e4a-8603-b38e34dfa90b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:53:40.783156 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b453d811-4500-4033-8177-e7ee10b6d798 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:40.783156 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b453d811-4500-4033-8177-e7ee10b6d798 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:40.783292 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b453d811-4500-4033-8177-e7ee10b6d798 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:40.783959 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b453d811-4500-4033-8177-e7ee10b6d798 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:40.784415 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b453d811-4500-4033-8177-e7ee10b6d798 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:40.784838 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b453d811-4500-4033-8177-e7ee10b6d798 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:40.798780 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.wsgi [None req-b453d811-4500-4033-8177-e7ee10b6d798 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] HTTP exception thrown: Instance a2b52a25-aa5a-4517-b43a-5f7648431777 could not be found. Oct 03 14:53:40.800338 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-b453d811-4500-4033-8177-e7ee10b6d798 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Request method failure captured: Oct 03 14:53:40.800338 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: request: GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 HTTP/1.1 Oct 03 14:53:40.800338 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept: application/json Oct 03 14:53:40.800338 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept-Encoding: identity Oct 03 14:53:40.800338 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Connection: close Oct 03 14:53:40.800338 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Length: 0 Oct 03 14:53:40.800338 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Type: application/json Oct 03 14:53:40.800338 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Host: 10.222.0.46 Oct 03 14:53:40.800338 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Openstack-System-Scope: None Oct 03 14:53:40.800338 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: User-Agent: python-urllib3/1.26.12 Oct 03 14:53:40.800338 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Auth-Token: gAAAAABjOvdHIZdx-NBWE-VajVtZLu-yI7O9h7pBOAzumdEY5_yRpCxjAp0yTdZv2OdCHdunb1yOsk4QLE3ZdykB8pDk_NGKP1MctM5h-gk3gn4n9Cja70ORKQNQ-yq1DAvlVPn0PfRm1O7zX1QMWkn6nYlfvph-7lkwBr09A8Wg_KmGvKKvg6o Oct 03 14:53:40.800338 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Id: None Oct 03 14:53:40.800338 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Name: None Oct 03 14:53:40.800338 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Identity-Status: Confirmed Oct 03 14:53:40.800338 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Is-Admin-Project: True Oct 03 14:53:40.800338 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Id: default Oct 03 14:53:40.800338 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Name: Default Oct 03 14:53:40.800338 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Id: 2a3f1ef0d0c343dfbf2eae49c0ea450c Oct 03 14:53:40.800338 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Name: tempest-VolumesNegativeTest-1482021882 Oct 03 14:53:40.800338 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Role: member,reader Oct 03 14:53:40.800338 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Roles: member,reader Oct 03 14:53:40.801583 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2a3f1ef0d0c343dfbf2eae49c0ea450c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2a3f1ef0d0c343dfbf2eae49c0ea450c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2a3f1ef0d0c343dfbf2eae49c0ea450c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2a3f1ef0d0c343dfbf2eae49c0ea450c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 14:53:40.801583 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant: tempest-VolumesNegativeTest-1482021882 Oct 03 14:53:40.801583 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Id: 2a3f1ef0d0c343dfbf2eae49c0ea450c Oct 03 14:53:40.801583 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Name: tempest-VolumesNegativeTest-1482021882 Oct 03 14:53:40.801583 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User: tempest-VolumesNegativeTest-1482021882-project Oct 03 14:53:40.801583 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Id: default Oct 03 14:53:40.801583 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Name: Default Oct 03 14:53:40.801583 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Id: fc880a31f5be4ea2a500bfa504749ce0 Oct 03 14:53:40.801583 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Name: tempest-VolumesNegativeTest-1482021882-project Oct 03 14:53:40.801583 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: method: > Oct 03 14:53:40.801583 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: exception: Instance a2b52a25-aa5a-4517-b43a-5f7648431777 could not be found. Oct 03 14:53:40.801583 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: action_args: {'id': 'a2b52a25-aa5a-4517-b43a-5f7648431777'} Oct 03 14:53:40.802257 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:53:40.802257 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:40.802257 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:53:40.802257 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:53:40.802257 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:53:40.802257 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:53:40.802257 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:53:40.802257 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:53:40.802257 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:53:40.802257 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:53:40.802257 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2b52a25-aa5a-4517-b43a-5f7648431777 could not be found. Oct 03 14:53:40.802257 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:53:40.802257 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:53:40.802257 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:53:40.802257 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:40.802257 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:53:40.802257 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:53:40.802257 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:53:40.802257 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:53:40.802257 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:53:40.804008 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:53:40.804008 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:53:40.804008 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:53:40.804008 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:53:40.804008 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:53:40.804008 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:53:40.804008 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:53:40.804008 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2b52a25-aa5a-4517-b43a-5f7648431777 could not be found. Oct 03 14:53:40.804008 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:53:40.804008 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:53:40.804008 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:53:40.804008 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:40.804008 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:53:40.804008 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:53:40.804008 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:53:40.804008 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:53:40.804008 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2b52a25-aa5a-4517-b43a-5f7648431777 could not be found. Oct 03 14:53:40.804008 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:53:40.805359 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-b453d811-4500-4033-8177-e7ee10b6d798 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] Returning 404 to user: Instance a2b52a25-aa5a-4517-b43a-5f7648431777 could not be found. {{(pid=126852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:53:40.805359 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-b453d811-4500-4033-8177-e7ee10b6d798 tempest-VolumesNegativeTest-1482021882 tempest-VolumesNegativeTest-1482021882-project] 10.222.0.46 "GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777" status: 404 len: 111 microversion: 2.1 time: 0.029513 Oct 03 14:53:40.805359 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 147/322] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:40 2022] GET /compute/v2.1/servers/a2b52a25-aa5a-4517-b43a-5f7648431777 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 14:53:41.283298 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-efe53608-b27c-4238-9929-b0f4d5947008 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:41.283757 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-efe53608-b27c-4238-9929-b0f4d5947008 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:41.291030 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-efe53608-b27c-4238-9929-b0f4d5947008 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:41.291614 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-efe53608-b27c-4238-9929-b0f4d5947008 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:41.292136 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-efe53608-b27c-4238-9929-b0f4d5947008 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:41.293071 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-efe53608-b27c-4238-9929-b0f4d5947008 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:41.293788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-efe53608-b27c-4238-9929-b0f4d5947008 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:41.294280 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-efe53608-b27c-4238-9929-b0f4d5947008 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:41.740263 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-efe53608-b27c-4238-9929-b0f4d5947008 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:41.753671 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-efe53608-b27c-4238-9929-b0f4d5947008 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1521 microversion: 2.1 time: 0.474768 Oct 03 14:53:41.764245 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 176/323] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:41 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1521 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:42.780140 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-afc20e47-598a-4a89-941b-101533c8a087 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:42.782019 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-afc20e47-598a-4a89-941b-101533c8a087 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:42.790619 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-afc20e47-598a-4a89-941b-101533c8a087 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:42.791770 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-afc20e47-598a-4a89-941b-101533c8a087 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:42.792369 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-afc20e47-598a-4a89-941b-101533c8a087 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:42.794142 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-afc20e47-598a-4a89-941b-101533c8a087 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:42.795543 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-afc20e47-598a-4a89-941b-101533c8a087 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:42.796276 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-afc20e47-598a-4a89-941b-101533c8a087 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:43.044247 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-afc20e47-598a-4a89-941b-101533c8a087 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:43.053131 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-afc20e47-598a-4a89-941b-101533c8a087 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1521 microversion: 2.1 time: 0.277492 Oct 03 14:53:43.060536 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 148/324] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:42 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:44.076336 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-638b04dc-9c3d-4451-9583-3cd09c1b67c8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:44.077607 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-638b04dc-9c3d-4451-9583-3cd09c1b67c8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:44.085395 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-638b04dc-9c3d-4451-9583-3cd09c1b67c8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:44.086076 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-638b04dc-9c3d-4451-9583-3cd09c1b67c8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:44.086685 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-638b04dc-9c3d-4451-9583-3cd09c1b67c8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:44.087682 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-638b04dc-9c3d-4451-9583-3cd09c1b67c8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:44.088519 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-638b04dc-9c3d-4451-9583-3cd09c1b67c8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:44.089146 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-638b04dc-9c3d-4451-9583-3cd09c1b67c8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:44.331185 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-638b04dc-9c3d-4451-9583-3cd09c1b67c8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:44.342433 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-638b04dc-9c3d-4451-9583-3cd09c1b67c8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1521 microversion: 2.1 time: 0.269830 Oct 03 14:53:44.362482 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 177/325] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:44 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:45.370108 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-4eb33d2c-352e-44c2-a8b6-f032912a422e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:45.370745 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-4eb33d2c-352e-44c2-a8b6-f032912a422e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:45.377411 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4eb33d2c-352e-44c2-a8b6-f032912a422e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:45.377917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4eb33d2c-352e-44c2-a8b6-f032912a422e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:45.378350 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4eb33d2c-352e-44c2-a8b6-f032912a422e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:45.379038 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4eb33d2c-352e-44c2-a8b6-f032912a422e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:45.379494 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4eb33d2c-352e-44c2-a8b6-f032912a422e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:45.379917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4eb33d2c-352e-44c2-a8b6-f032912a422e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:45.548022 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-4eb33d2c-352e-44c2-a8b6-f032912a422e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:45.556183 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-4eb33d2c-352e-44c2-a8b6-f032912a422e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1521 microversion: 2.1 time: 0.189976 Oct 03 14:53:45.556914 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 149/326] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:45 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:46.579753 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-dda7b808-8cd4-426f-9319-3693d9848f79 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:46.580367 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-dda7b808-8cd4-426f-9319-3693d9848f79 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:46.586372 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dda7b808-8cd4-426f-9319-3693d9848f79 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:46.587078 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dda7b808-8cd4-426f-9319-3693d9848f79 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:46.587737 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dda7b808-8cd4-426f-9319-3693d9848f79 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:46.588654 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dda7b808-8cd4-426f-9319-3693d9848f79 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:46.589255 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dda7b808-8cd4-426f-9319-3693d9848f79 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:46.589897 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dda7b808-8cd4-426f-9319-3693d9848f79 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:46.762816 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-dda7b808-8cd4-426f-9319-3693d9848f79 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:46.771050 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-dda7b808-8cd4-426f-9319-3693d9848f79 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1521 microversion: 2.1 time: 0.195694 Oct 03 14:53:46.772036 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 178/327] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:46 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:47.794523 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-e0fd21ff-1db2-4b2b-bbcd-467d31da876c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:47.795165 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-e0fd21ff-1db2-4b2b-bbcd-467d31da876c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:47.802266 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e0fd21ff-1db2-4b2b-bbcd-467d31da876c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:47.802964 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e0fd21ff-1db2-4b2b-bbcd-467d31da876c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:47.803557 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e0fd21ff-1db2-4b2b-bbcd-467d31da876c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:47.805785 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e0fd21ff-1db2-4b2b-bbcd-467d31da876c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:47.806424 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e0fd21ff-1db2-4b2b-bbcd-467d31da876c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:47.807047 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e0fd21ff-1db2-4b2b-bbcd-467d31da876c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:48.081067 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-e0fd21ff-1db2-4b2b-bbcd-467d31da876c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:48.096208 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-e0fd21ff-1db2-4b2b-bbcd-467d31da876c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1521 microversion: 2.1 time: 0.304564 Oct 03 14:53:48.099046 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 150/328] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:47 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:49.121169 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-d316cb3d-6ec6-4131-a542-1bae3c3e3102 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:49.122785 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-d316cb3d-6ec6-4131-a542-1bae3c3e3102 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:49.130316 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d316cb3d-6ec6-4131-a542-1bae3c3e3102 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:49.130951 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d316cb3d-6ec6-4131-a542-1bae3c3e3102 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:49.131391 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d316cb3d-6ec6-4131-a542-1bae3c3e3102 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:49.132128 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d316cb3d-6ec6-4131-a542-1bae3c3e3102 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:49.132635 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d316cb3d-6ec6-4131-a542-1bae3c3e3102 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:49.133224 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d316cb3d-6ec6-4131-a542-1bae3c3e3102 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:49.315644 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-d316cb3d-6ec6-4131-a542-1bae3c3e3102 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:49.323357 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-d316cb3d-6ec6-4131-a542-1bae3c3e3102 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1521 microversion: 2.1 time: 0.206866 Oct 03 14:53:49.331568 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 179/329] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:49 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:50.349449 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-886c1f5f-64a9-4a5f-99c3-92560026f553 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:50.350421 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-886c1f5f-64a9-4a5f-99c3-92560026f553 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:50.358157 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-886c1f5f-64a9-4a5f-99c3-92560026f553 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:50.359472 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-886c1f5f-64a9-4a5f-99c3-92560026f553 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:50.360028 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-886c1f5f-64a9-4a5f-99c3-92560026f553 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:50.360830 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-886c1f5f-64a9-4a5f-99c3-92560026f553 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:50.361700 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-886c1f5f-64a9-4a5f-99c3-92560026f553 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:50.362372 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-886c1f5f-64a9-4a5f-99c3-92560026f553 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:50.634737 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-886c1f5f-64a9-4a5f-99c3-92560026f553 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:50.645617 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-886c1f5f-64a9-4a5f-99c3-92560026f553 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1521 microversion: 2.1 time: 0.300757 Oct 03 14:53:50.673684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 151/330] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:50 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1521 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:51.673137 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-db606d91-e9d7-4938-8d4b-c0d8716a2238 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:51.673969 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-db606d91-e9d7-4938-8d4b-c0d8716a2238 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:51.681361 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-db606d91-e9d7-4938-8d4b-c0d8716a2238 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:51.681995 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-db606d91-e9d7-4938-8d4b-c0d8716a2238 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:51.682448 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-db606d91-e9d7-4938-8d4b-c0d8716a2238 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:51.683298 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-db606d91-e9d7-4938-8d4b-c0d8716a2238 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:51.683756 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-db606d91-e9d7-4938-8d4b-c0d8716a2238 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:51.684850 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-db606d91-e9d7-4938-8d4b-c0d8716a2238 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:51.889077 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-db606d91-e9d7-4938-8d4b-c0d8716a2238 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:51.913007 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-db606d91-e9d7-4938-8d4b-c0d8716a2238 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1521 microversion: 2.1 time: 0.244347 Oct 03 14:53:51.925442 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 180/331] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:51 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:52.938422 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-2540470f-6ef8-4315-9f11-3a621b86cdb3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:52.939269 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-2540470f-6ef8-4315-9f11-3a621b86cdb3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:52.942387 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:52.948588 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2540470f-6ef8-4315-9f11-3a621b86cdb3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:52.949140 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2540470f-6ef8-4315-9f11-3a621b86cdb3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:52.949610 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2540470f-6ef8-4315-9f11-3a621b86cdb3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:52.950323 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2540470f-6ef8-4315-9f11-3a621b86cdb3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:52.950782 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2540470f-6ef8-4315-9f11-3a621b86cdb3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:52.951207 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2540470f-6ef8-4315-9f11-3a621b86cdb3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:53.187015 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-2540470f-6ef8-4315-9f11-3a621b86cdb3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:53.197654 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-2540470f-6ef8-4315-9f11-3a621b86cdb3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1501 microversion: 2.1 time: 0.265186 Oct 03 14:53:53.207459 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 152/332] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:52 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1501 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:53.223785 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-bb7c7d44-e19d-4d4f-bce4-d87dbdd65021 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:53.224540 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-bb7c7d44-e19d-4d4f-bce4-d87dbdd65021 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:53.231756 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bb7c7d44-e19d-4d4f-bce4-d87dbdd65021 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:53.232554 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bb7c7d44-e19d-4d4f-bce4-d87dbdd65021 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:53.233933 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bb7c7d44-e19d-4d4f-bce4-d87dbdd65021 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:53.234910 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bb7c7d44-e19d-4d4f-bce4-d87dbdd65021 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:53.235611 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bb7c7d44-e19d-4d4f-bce4-d87dbdd65021 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:53.236481 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bb7c7d44-e19d-4d4f-bce4-d87dbdd65021 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:53.442106 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-bb7c7d44-e19d-4d4f-bce4-d87dbdd65021 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:53.449775 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-bb7c7d44-e19d-4d4f-bce4-d87dbdd65021 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3" status: 200 len: 1517 microversion: 2.1 time: 0.233284 Oct 03 14:53:53.452770 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 181/333] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:53 2022] GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3 => generated 1517 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:57.186351 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-444a62c4-5302-4ebe-a2d1-9650a870f537 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Action: 'create', calling method: .version_select at 0x7fe0d36b75e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-296655480", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKs5RKx5QFM61hsV51+P9zzxdZfvHzMI9BlDR23YFzz0Kl6jmDg3E53FSVRljzCPvus7h2GVhP8KtIU8NpzISI64AKhTZwyvqbU1D/CXxhqqHMdOHt/e3wRCWMGEHUEaag=="}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:53:57.207034 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-444a62c4-5302-4ebe-a2d1-9650a870f537 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Getting quotas for project a167b2ccacbc4e6d903b09d9a00650fe. Resources: {'key_pairs'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:53:57.212543 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-444a62c4-5302-4ebe-a2d1-9650a870f537 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Getting quotas for user 7cfae014351641d8a949775875a45958 and project a167b2ccacbc4e6d903b09d9a00650fe. Resources: {'key_pairs'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:53:57.241483 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-444a62c4-5302-4ebe-a2d1-9650a870f537 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.237767 Oct 03 14:53:57.242116 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 153/334] 10.222.0.46 () {60 vars in 1159 bytes} [Mon Oct 3 14:53:57 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:54:00.338840 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-635a695b-4b58-4fa0-b609-8eb393fcc94e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:54:00.341058 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-635a695b-4b58-4fa0-b609-8eb393fcc94e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:00.348099 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-635a695b-4b58-4fa0-b609-8eb393fcc94e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:00.348590 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-635a695b-4b58-4fa0-b609-8eb393fcc94e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:00.349026 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-635a695b-4b58-4fa0-b609-8eb393fcc94e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:00.349752 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-635a695b-4b58-4fa0-b609-8eb393fcc94e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:00.350205 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-635a695b-4b58-4fa0-b609-8eb393fcc94e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:00.350643 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-635a695b-4b58-4fa0-b609-8eb393fcc94e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:00.373114 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.objects.instance [None req-635a695b-4b58-4fa0-b609-8eb393fcc94e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lazy-loading 'flavor' on Instance uuid 93eb4038-8732-40ab-b4ff-b9ba16dab3f3 {{(pid=126851) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:54:00.452117 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-635a695b-4b58-4fa0-b609-8eb393fcc94e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "POST /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3/action" status: 200 len: 32 microversion: 2.1 time: 0.116727 Oct 03 14:54:00.454055 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 182/335] 10.222.0.46 () {60 vars in 1278 bytes} [Mon Oct 3 14:54:00 2022] POST /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3/action => generated 32 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:54:00.463441 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-7fef3cd4-485c-4c12-aab8-81d5e914a0fa tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:00.464060 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-7fef3cd4-485c-4c12-aab8-81d5e914a0fa tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:00.473346 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7fef3cd4-485c-4c12-aab8-81d5e914a0fa tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:00.474299 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7fef3cd4-485c-4c12-aab8-81d5e914a0fa tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:00.475271 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7fef3cd4-485c-4c12-aab8-81d5e914a0fa tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:00.476173 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7fef3cd4-485c-4c12-aab8-81d5e914a0fa tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:00.476640 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7fef3cd4-485c-4c12-aab8-81d5e914a0fa tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:00.477171 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7fef3cd4-485c-4c12-aab8-81d5e914a0fa tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:00.694909 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-7fef3cd4-485c-4c12-aab8-81d5e914a0fa tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:00.705822 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-7fef3cd4-485c-4c12-aab8-81d5e914a0fa tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3" status: 200 len: 1523 microversion: 2.1 time: 0.246972 Oct 03 14:54:00.706734 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 154/336] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:00 2022] GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3 => generated 1523 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:54:01.730073 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-5d92b487-5180-47d6-bceb-9c9398a1f5ba tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:01.730760 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-5d92b487-5180-47d6-bceb-9c9398a1f5ba tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:01.736761 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5d92b487-5180-47d6-bceb-9c9398a1f5ba tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:01.737242 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5d92b487-5180-47d6-bceb-9c9398a1f5ba tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:01.737694 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5d92b487-5180-47d6-bceb-9c9398a1f5ba tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:01.738370 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5d92b487-5180-47d6-bceb-9c9398a1f5ba tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:01.738816 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5d92b487-5180-47d6-bceb-9c9398a1f5ba tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:01.739234 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5d92b487-5180-47d6-bceb-9c9398a1f5ba tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:01.948348 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-5d92b487-5180-47d6-bceb-9c9398a1f5ba tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:01.957630 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-5d92b487-5180-47d6-bceb-9c9398a1f5ba tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3" status: 200 len: 1523 microversion: 2.1 time: 0.231764 Oct 03 14:54:01.958348 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 183/337] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:01 2022] GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3 => generated 1523 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:02.982598 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-1467a34e-6275-4555-80f7-771f4bb2fb93 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:02.985193 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-1467a34e-6275-4555-80f7-771f4bb2fb93 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:02.990818 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1467a34e-6275-4555-80f7-771f4bb2fb93 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:02.991312 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1467a34e-6275-4555-80f7-771f4bb2fb93 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:02.991757 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1467a34e-6275-4555-80f7-771f4bb2fb93 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:02.992457 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1467a34e-6275-4555-80f7-771f4bb2fb93 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:02.993260 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1467a34e-6275-4555-80f7-771f4bb2fb93 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:02.993341 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1467a34e-6275-4555-80f7-771f4bb2fb93 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:03.150893 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-1467a34e-6275-4555-80f7-771f4bb2fb93 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:03.161369 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-1467a34e-6275-4555-80f7-771f4bb2fb93 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3" status: 200 len: 1523 microversion: 2.1 time: 0.182635 Oct 03 14:54:03.162388 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 155/338] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:02 2022] GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:04.184417 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-8ec52e45-cc24-4de1-acaa-fc6a15cb356e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:04.185014 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-8ec52e45-cc24-4de1-acaa-fc6a15cb356e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:04.191586 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8ec52e45-cc24-4de1-acaa-fc6a15cb356e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:04.192069 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8ec52e45-cc24-4de1-acaa-fc6a15cb356e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:04.192496 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8ec52e45-cc24-4de1-acaa-fc6a15cb356e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:04.193191 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8ec52e45-cc24-4de1-acaa-fc6a15cb356e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:04.193663 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8ec52e45-cc24-4de1-acaa-fc6a15cb356e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:04.194081 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8ec52e45-cc24-4de1-acaa-fc6a15cb356e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:04.369740 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-8ec52e45-cc24-4de1-acaa-fc6a15cb356e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:04.373784 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:54:04.379969 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-8ec52e45-cc24-4de1-acaa-fc6a15cb356e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3" status: 200 len: 1523 microversion: 2.1 time: 0.199267 Oct 03 14:54:04.380546 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 184/339] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:04 2022] GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3 => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:05.402669 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-64dda1e3-bb60-4ecb-955b-33a5f9f5e025 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:05.403277 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-64dda1e3-bb60-4ecb-955b-33a5f9f5e025 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:05.410284 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-64dda1e3-bb60-4ecb-955b-33a5f9f5e025 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:05.410806 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-64dda1e3-bb60-4ecb-955b-33a5f9f5e025 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:05.411287 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-64dda1e3-bb60-4ecb-955b-33a5f9f5e025 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:05.412083 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-64dda1e3-bb60-4ecb-955b-33a5f9f5e025 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:05.412710 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-64dda1e3-bb60-4ecb-955b-33a5f9f5e025 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:05.413204 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-64dda1e3-bb60-4ecb-955b-33a5f9f5e025 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:05.417804 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=99 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:54:05.550858 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-64dda1e3-bb60-4ecb-955b-33a5f9f5e025 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:05.558963 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-64dda1e3-bb60-4ecb-955b-33a5f9f5e025 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3" status: 200 len: 1523 microversion: 2.1 time: 0.160057 Oct 03 14:54:05.559529 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 156/340] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:05 2022] GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:06.583922 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-33d496ba-c47b-43ee-be02-77ff389f6826 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:06.584561 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-33d496ba-c47b-43ee-be02-77ff389f6826 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:06.590983 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-33d496ba-c47b-43ee-be02-77ff389f6826 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:06.591721 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-33d496ba-c47b-43ee-be02-77ff389f6826 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:06.592156 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-33d496ba-c47b-43ee-be02-77ff389f6826 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:06.592841 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-33d496ba-c47b-43ee-be02-77ff389f6826 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:06.593299 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-33d496ba-c47b-43ee-be02-77ff389f6826 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:06.593746 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-33d496ba-c47b-43ee-be02-77ff389f6826 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:06.991044 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-33d496ba-c47b-43ee-be02-77ff389f6826 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:06.998649 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-33d496ba-c47b-43ee-be02-77ff389f6826 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3" status: 200 len: 1523 microversion: 2.1 time: 0.419105 Oct 03 14:54:06.999203 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 185/341] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:06 2022] GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3 => generated 1523 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:08.021315 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-c34e63f4-002f-43b2-bb1b-c85508f66bfe tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:08.021960 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-c34e63f4-002f-43b2-bb1b-c85508f66bfe tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:08.024241 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell0:SELECT=4 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:54:08.030026 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c34e63f4-002f-43b2-bb1b-c85508f66bfe tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:08.030509 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c34e63f4-002f-43b2-bb1b-c85508f66bfe tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:08.030943 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c34e63f4-002f-43b2-bb1b-c85508f66bfe tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:08.031631 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c34e63f4-002f-43b2-bb1b-c85508f66bfe tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:08.032087 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c34e63f4-002f-43b2-bb1b-c85508f66bfe tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:08.032511 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c34e63f4-002f-43b2-bb1b-c85508f66bfe tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:08.162137 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-c34e63f4-002f-43b2-bb1b-c85508f66bfe tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:08.169662 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-c34e63f4-002f-43b2-bb1b-c85508f66bfe tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3" status: 200 len: 1523 microversion: 2.1 time: 0.152203 Oct 03 14:54:08.170855 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 157/342] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:08 2022] GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:09.195602 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-fc4dd44e-ef09-4393-a99c-6fa4b99e2119 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:09.196229 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-fc4dd44e-ef09-4393-a99c-6fa4b99e2119 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:09.202648 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fc4dd44e-ef09-4393-a99c-6fa4b99e2119 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:09.203127 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fc4dd44e-ef09-4393-a99c-6fa4b99e2119 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:09.203553 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fc4dd44e-ef09-4393-a99c-6fa4b99e2119 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:09.204272 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fc4dd44e-ef09-4393-a99c-6fa4b99e2119 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:09.204728 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fc4dd44e-ef09-4393-a99c-6fa4b99e2119 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:09.205138 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fc4dd44e-ef09-4393-a99c-6fa4b99e2119 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:09.336358 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-fc4dd44e-ef09-4393-a99c-6fa4b99e2119 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:09.344363 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-fc4dd44e-ef09-4393-a99c-6fa4b99e2119 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3" status: 200 len: 1523 microversion: 2.1 time: 0.153135 Oct 03 14:54:09.344919 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 186/343] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:09 2022] GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:10.370004 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-4af411cd-2833-4589-9377-ae5768b307b3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:10.370621 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-4af411cd-2833-4589-9377-ae5768b307b3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:10.377213 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4af411cd-2833-4589-9377-ae5768b307b3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:10.377727 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4af411cd-2833-4589-9377-ae5768b307b3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:10.378161 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4af411cd-2833-4589-9377-ae5768b307b3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:10.378843 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4af411cd-2833-4589-9377-ae5768b307b3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:10.379294 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4af411cd-2833-4589-9377-ae5768b307b3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:10.379714 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4af411cd-2833-4589-9377-ae5768b307b3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:10.528372 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-4af411cd-2833-4589-9377-ae5768b307b3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:10.547736 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-4af411cd-2833-4589-9377-ae5768b307b3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3" status: 200 len: 1523 microversion: 2.1 time: 0.181633 Oct 03 14:54:10.548324 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 158/344] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:10 2022] GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:11.570520 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-47d77add-1c8b-4618-a719-890ccd184a51 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:11.571028 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-47d77add-1c8b-4618-a719-890ccd184a51 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:11.572942 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_api:SELECT=30 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:54:11.578542 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-47d77add-1c8b-4618-a719-890ccd184a51 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:11.579026 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-47d77add-1c8b-4618-a719-890ccd184a51 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:11.579460 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-47d77add-1c8b-4618-a719-890ccd184a51 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:11.580147 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-47d77add-1c8b-4618-a719-890ccd184a51 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:11.580603 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-47d77add-1c8b-4618-a719-890ccd184a51 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:11.581027 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-47d77add-1c8b-4618-a719-890ccd184a51 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:11.718947 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-47d77add-1c8b-4618-a719-890ccd184a51 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:11.726544 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-47d77add-1c8b-4618-a719-890ccd184a51 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3" status: 200 len: 1523 microversion: 2.1 time: 0.159911 Oct 03 14:54:11.727591 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 187/345] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:11 2022] GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:12.750187 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-743b5128-34c4-4d27-b493-35dfb848411f tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:12.750978 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-743b5128-34c4-4d27-b493-35dfb848411f tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:12.757560 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-743b5128-34c4-4d27-b493-35dfb848411f tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:12.758115 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-743b5128-34c4-4d27-b493-35dfb848411f tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:12.761573 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-743b5128-34c4-4d27-b493-35dfb848411f tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:12.762282 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-743b5128-34c4-4d27-b493-35dfb848411f tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:12.762744 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-743b5128-34c4-4d27-b493-35dfb848411f tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:12.763167 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-743b5128-34c4-4d27-b493-35dfb848411f tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:12.898458 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-743b5128-34c4-4d27-b493-35dfb848411f tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:12.907732 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-743b5128-34c4-4d27-b493-35dfb848411f tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3" status: 200 len: 1523 microversion: 2.1 time: 0.161398 Oct 03 14:54:12.908385 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 159/346] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:12 2022] GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:13.931458 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-b052ef21-8aba-4a31-ae18-564226fa2ac8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:13.932067 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-b052ef21-8aba-4a31-ae18-564226fa2ac8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:13.938786 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b052ef21-8aba-4a31-ae18-564226fa2ac8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:13.939278 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b052ef21-8aba-4a31-ae18-564226fa2ac8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:13.939715 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b052ef21-8aba-4a31-ae18-564226fa2ac8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:13.940415 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b052ef21-8aba-4a31-ae18-564226fa2ac8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:13.941244 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b052ef21-8aba-4a31-ae18-564226fa2ac8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:13.941385 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b052ef21-8aba-4a31-ae18-564226fa2ac8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:14.075404 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-b052ef21-8aba-4a31-ae18-564226fa2ac8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:14.084584 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-b052ef21-8aba-4a31-ae18-564226fa2ac8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3" status: 200 len: 1523 microversion: 2.1 time: 0.157607 Oct 03 14:54:14.085698 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 188/347] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:13 2022] GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:15.111041 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-7ee81b93-e3c1-4882-b627-49395cd0f534 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:15.111650 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-7ee81b93-e3c1-4882-b627-49395cd0f534 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:15.117966 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7ee81b93-e3c1-4882-b627-49395cd0f534 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:15.118457 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7ee81b93-e3c1-4882-b627-49395cd0f534 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:15.118900 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7ee81b93-e3c1-4882-b627-49395cd0f534 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:15.119596 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7ee81b93-e3c1-4882-b627-49395cd0f534 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:15.120055 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7ee81b93-e3c1-4882-b627-49395cd0f534 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:15.120479 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7ee81b93-e3c1-4882-b627-49395cd0f534 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:15.261173 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-7ee81b93-e3c1-4882-b627-49395cd0f534 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:15.269957 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-7ee81b93-e3c1-4882-b627-49395cd0f534 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3" status: 200 len: 1523 microversion: 2.1 time: 0.163659 Oct 03 14:54:15.270535 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 160/348] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:15 2022] GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:16.292710 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-aa45e503-40fe-4d84-a126-d69c0604ed78 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:16.293317 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-aa45e503-40fe-4d84-a126-d69c0604ed78 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:16.300573 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-aa45e503-40fe-4d84-a126-d69c0604ed78 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:16.301055 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-aa45e503-40fe-4d84-a126-d69c0604ed78 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:16.301490 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-aa45e503-40fe-4d84-a126-d69c0604ed78 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:16.302203 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-aa45e503-40fe-4d84-a126-d69c0604ed78 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:16.302660 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-aa45e503-40fe-4d84-a126-d69c0604ed78 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:16.303082 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-aa45e503-40fe-4d84-a126-d69c0604ed78 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:16.441838 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-aa45e503-40fe-4d84-a126-d69c0604ed78 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:16.452571 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-aa45e503-40fe-4d84-a126-d69c0604ed78 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3" status: 200 len: 1523 microversion: 2.1 time: 0.163514 Oct 03 14:54:16.453617 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 189/349] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:16 2022] GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:17.475926 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-f51cb414-9a5d-42b2-9626-ff5be1abfac9 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:17.476534 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-f51cb414-9a5d-42b2-9626-ff5be1abfac9 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:17.483765 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f51cb414-9a5d-42b2-9626-ff5be1abfac9 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:17.484161 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f51cb414-9a5d-42b2-9626-ff5be1abfac9 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:17.484590 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f51cb414-9a5d-42b2-9626-ff5be1abfac9 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:17.485272 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f51cb414-9a5d-42b2-9626-ff5be1abfac9 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:17.485750 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f51cb414-9a5d-42b2-9626-ff5be1abfac9 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:17.486171 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f51cb414-9a5d-42b2-9626-ff5be1abfac9 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:17.617708 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-f51cb414-9a5d-42b2-9626-ff5be1abfac9 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:17.630475 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-f51cb414-9a5d-42b2-9626-ff5be1abfac9 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3" status: 200 len: 1503 microversion: 2.1 time: 0.154516 Oct 03 14:54:17.630475 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 161/350] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:17 2022] GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:17.653480 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-2daee3c5-3029-4aaf-b27d-1c13e10b47d6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b31fc8bb-3b90-49b3-935f-f0d11c061bbf"}} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:54:17.656600 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-2daee3c5-3029-4aaf-b27d-1c13e10b47d6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:17.662825 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2daee3c5-3029-4aaf-b27d-1c13e10b47d6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:17.663385 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2daee3c5-3029-4aaf-b27d-1c13e10b47d6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:17.663831 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2daee3c5-3029-4aaf-b27d-1c13e10b47d6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:17.664758 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2daee3c5-3029-4aaf-b27d-1c13e10b47d6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:17.665219 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2daee3c5-3029-4aaf-b27d-1c13e10b47d6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:17.665674 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2daee3c5-3029-4aaf-b27d-1c13e10b47d6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:17.691974 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.wsgi [None req-2daee3c5-3029-4aaf-b27d-1c13e10b47d6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] HTTP exception thrown: Cannot 'attach_volume' instance 93eb4038-8732-40ab-b4ff-b9ba16dab3f3 while it is in vm_state rescued Oct 03 14:54:17.693862 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-2daee3c5-3029-4aaf-b27d-1c13e10b47d6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Request method failure captured: Oct 03 14:54:17.693862 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: request: POST /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3/os-volume_attachments HTTP/1.1 Oct 03 14:54:17.693862 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept: application/json Oct 03 14:54:17.693862 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept-Encoding: identity Oct 03 14:54:17.693862 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Connection: close Oct 03 14:54:17.693862 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Length: 74 Oct 03 14:54:17.693862 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Type: application/json Oct 03 14:54:17.693862 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Host: 10.222.0.46 Oct 03 14:54:17.693862 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Openstack-System-Scope: None Oct 03 14:54:17.693862 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: User-Agent: python-urllib3/1.26.12 Oct 03 14:54:17.693862 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Auth-Token: gAAAAABjOvcVbKiHnNy90WglqYe5Q1MwexWf6mCQgnW_RoYIDHCKZyjYComPW_WJfpkmYdPGmBh_lHytVTlk3gOxTumrJiqzfNInV4R1Rg-YBW8I7tzJMuPKobbPL6KZa8sK-WadPvCsNgL3ob2ccjWgfOhEn-3_ZHmMK9Tu9uRhH_3sf5LyZ5o Oct 03 14:54:17.693862 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Id: None Oct 03 14:54:17.693862 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Name: None Oct 03 14:54:17.693862 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Identity-Status: Confirmed Oct 03 14:54:17.693862 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Is-Admin-Project: True Oct 03 14:54:17.693862 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Id: default Oct 03 14:54:17.693862 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Name: Default Oct 03 14:54:17.693862 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Id: 83b495f3cb9b437d9572f4d33327fbf7 Oct 03 14:54:17.693862 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-685876426 Oct 03 14:54:17.693862 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Role: member,reader Oct 03 14:54:17.693862 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Roles: member,reader Oct 03 14:54:17.695465 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/83b495f3cb9b437d9572f4d33327fbf7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_83b495f3cb9b437d9572f4d33327fbf7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/83b495f3cb9b437d9572f4d33327fbf7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/83b495f3cb9b437d9572f4d33327fbf7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 14:54:17.695465 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant: tempest-ServerRescueNegativeTestJSON-685876426 Oct 03 14:54:17.695465 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Id: 83b495f3cb9b437d9572f4d33327fbf7 Oct 03 14:54:17.695465 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-685876426 Oct 03 14:54:17.695465 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User: tempest-ServerRescueNegativeTestJSON-685876426-project Oct 03 14:54:17.695465 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Id: default Oct 03 14:54:17.695465 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Name: Default Oct 03 14:54:17.695465 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Id: 335dd8706d4c402e98605479b57d059a Oct 03 14:54:17.695465 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Name: tempest-ServerRescueNegativeTestJSON-685876426-project Oct 03 14:54:17.695465 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Oct 03 14:54:17.695465 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: {"volumeAttachment": {"volumeId": "b31fc8bb-3b90-49b3-935f-f0d11c061bbf"}} Oct 03 14:54:17.695465 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: method: > Oct 03 14:54:17.696172 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: exception: Cannot 'attach_volume' instance 93eb4038-8732-40ab-b4ff-b9ba16dab3f3 while it is in vm_state rescued Oct 03 14:54:17.696172 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: action_args: {'server_id': '93eb4038-8732-40ab-b4ff-b9ba16dab3f3', 'body': {'volumeAttachment': {'volumeId': 'b31fc8bb-3b90-49b3-935f-f0d11c061bbf'}}} Oct 03 14:54:17.696172 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:54:17.696172 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:17.696172 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 03 14:54:17.696172 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 03 14:54:17.696172 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 14:54:17.696172 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 14:54:17.696172 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 03 14:54:17.696172 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 03 14:54:17.696172 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 93eb4038-8732-40ab-b4ff-b9ba16dab3f3 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 03 14:54:17.696172 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:54:17.696172 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:54:17.696172 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:54:17.696172 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:17.696172 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:54:17.696172 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:54:17.696172 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:54:17.696172 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:54:17.697254 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:54:17.697254 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:54:17.697254 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:54:17.697254 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:54:17.697254 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:54:17.697254 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:54:17.697254 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:54:17.697254 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:54:17.697254 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 03 14:54:17.697254 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 03 14:54:17.697254 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 03 14:54:17.697254 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 14:54:17.697254 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 93eb4038-8732-40ab-b4ff-b9ba16dab3f3 while it is in vm_state rescued Oct 03 14:54:17.697254 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:54:17.697254 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:54:17.697254 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:54:17.697254 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:17.697254 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:54:17.697254 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:54:17.698320 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:54:17.698320 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:54:17.698320 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 93eb4038-8732-40ab-b4ff-b9ba16dab3f3 while it is in vm_state rescued Oct 03 14:54:17.698320 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:54:17.698320 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-2daee3c5-3029-4aaf-b27d-1c13e10b47d6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Returning 409 to user: Cannot 'attach_volume' instance 93eb4038-8732-40ab-b4ff-b9ba16dab3f3 while it is in vm_state rescued {{(pid=126851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:54:17.698320 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-2daee3c5-3029-4aaf-b27d-1c13e10b47d6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "POST /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047772 Oct 03 14:54:17.698320 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 190/351] 10.222.0.46 () {60 vars in 1323 bytes} [Mon Oct 3 14:54:17 2022] POST /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3/os-volume_attachments => generated 152 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:54:17.704748 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-e951fdb2-6bf4-4207-8850-304fb880a903 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:54:17.705320 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-e951fdb2-6bf4-4207-8850-304fb880a903 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:17.711351 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e951fdb2-6bf4-4207-8850-304fb880a903 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:17.711836 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e951fdb2-6bf4-4207-8850-304fb880a903 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:17.712275 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e951fdb2-6bf4-4207-8850-304fb880a903 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:17.713003 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e951fdb2-6bf4-4207-8850-304fb880a903 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:17.713462 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e951fdb2-6bf4-4207-8850-304fb880a903 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:17.713911 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e951fdb2-6bf4-4207-8850-304fb880a903 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:17.783135 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-e951fdb2-6bf4-4207-8850-304fb880a903 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "POST /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3/action" status: 202 len: 0 microversion: 2.1 time: 0.082227 Oct 03 14:54:17.784330 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 162/352] 10.222.0.46 () {60 vars in 1278 bytes} [Mon Oct 3 14:54:17 2022] POST /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:54:17.793836 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-42d45e07-68fc-4287-badb-10f4e320819d tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:17.794827 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-42d45e07-68fc-4287-badb-10f4e320819d tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:17.802647 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-42d45e07-68fc-4287-badb-10f4e320819d tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:17.803426 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-42d45e07-68fc-4287-badb-10f4e320819d tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:17.804391 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-42d45e07-68fc-4287-badb-10f4e320819d tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:17.805303 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-42d45e07-68fc-4287-badb-10f4e320819d tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:17.805998 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-42d45e07-68fc-4287-badb-10f4e320819d tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:17.806607 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-42d45e07-68fc-4287-badb-10f4e320819d tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:17.986149 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-42d45e07-68fc-4287-badb-10f4e320819d tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:17.998070 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-42d45e07-68fc-4287-badb-10f4e320819d tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3" status: 200 len: 1511 microversion: 2.1 time: 0.209690 Oct 03 14:54:17.998820 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 191/353] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:17 2022] GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3 => generated 1511 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:19.022682 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-91cf9876-5539-4326-b629-4c9f4ef9aa7b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:19.023569 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-91cf9876-5539-4326-b629-4c9f4ef9aa7b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:19.030147 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-91cf9876-5539-4326-b629-4c9f4ef9aa7b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:19.030625 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-91cf9876-5539-4326-b629-4c9f4ef9aa7b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:19.031056 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-91cf9876-5539-4326-b629-4c9f4ef9aa7b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:19.031737 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-91cf9876-5539-4326-b629-4c9f4ef9aa7b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:19.032186 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-91cf9876-5539-4326-b629-4c9f4ef9aa7b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:19.032601 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-91cf9876-5539-4326-b629-4c9f4ef9aa7b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:19.158769 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-91cf9876-5539-4326-b629-4c9f4ef9aa7b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:19.166420 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-91cf9876-5539-4326-b629-4c9f4ef9aa7b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3" status: 200 len: 1511 microversion: 2.1 time: 0.147857 Oct 03 14:54:19.166972 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 163/354] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:19 2022] GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3 => generated 1511 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:20.189955 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-767040fe-3845-49a7-a2da-7d32ddfdace6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:20.190553 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-767040fe-3845-49a7-a2da-7d32ddfdace6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:20.196425 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-767040fe-3845-49a7-a2da-7d32ddfdace6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:20.196844 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-767040fe-3845-49a7-a2da-7d32ddfdace6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:20.197278 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-767040fe-3845-49a7-a2da-7d32ddfdace6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:20.197989 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-767040fe-3845-49a7-a2da-7d32ddfdace6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:20.198438 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-767040fe-3845-49a7-a2da-7d32ddfdace6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:20.198852 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-767040fe-3845-49a7-a2da-7d32ddfdace6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:20.331746 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-767040fe-3845-49a7-a2da-7d32ddfdace6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:20.339225 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-767040fe-3845-49a7-a2da-7d32ddfdace6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3" status: 200 len: 1511 microversion: 2.1 time: 0.153609 Oct 03 14:54:20.339785 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 192/355] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:20 2022] GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3 => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:21.362214 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-76f6a84b-7741-4a13-8d9f-bb0ab926c293 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:21.362847 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-76f6a84b-7741-4a13-8d9f-bb0ab926c293 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:21.369346 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-76f6a84b-7741-4a13-8d9f-bb0ab926c293 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:21.369870 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-76f6a84b-7741-4a13-8d9f-bb0ab926c293 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:21.370303 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-76f6a84b-7741-4a13-8d9f-bb0ab926c293 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:21.370982 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-76f6a84b-7741-4a13-8d9f-bb0ab926c293 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:21.371430 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-76f6a84b-7741-4a13-8d9f-bb0ab926c293 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:21.371845 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-76f6a84b-7741-4a13-8d9f-bb0ab926c293 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:21.498788 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-76f6a84b-7741-4a13-8d9f-bb0ab926c293 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:21.506315 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-76f6a84b-7741-4a13-8d9f-bb0ab926c293 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3" status: 200 len: 1511 microversion: 2.1 time: 0.147912 Oct 03 14:54:21.506872 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 164/356] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:21 2022] GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3 => generated 1511 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:22.529341 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-b70ea370-1c7b-4ae2-87ff-c6dc9cb96166 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:22.530453 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-b70ea370-1c7b-4ae2-87ff-c6dc9cb96166 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:22.536414 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b70ea370-1c7b-4ae2-87ff-c6dc9cb96166 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:22.536893 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b70ea370-1c7b-4ae2-87ff-c6dc9cb96166 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:22.537324 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b70ea370-1c7b-4ae2-87ff-c6dc9cb96166 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:22.538179 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b70ea370-1c7b-4ae2-87ff-c6dc9cb96166 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:22.538641 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b70ea370-1c7b-4ae2-87ff-c6dc9cb96166 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:22.539065 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b70ea370-1c7b-4ae2-87ff-c6dc9cb96166 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:22.663352 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-b70ea370-1c7b-4ae2-87ff-c6dc9cb96166 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:22.671079 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-b70ea370-1c7b-4ae2-87ff-c6dc9cb96166 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3" status: 200 len: 1511 microversion: 2.1 time: 0.145548 Oct 03 14:54:22.671644 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 193/357] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:22 2022] GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3 => generated 1511 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:23.693927 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-121079cd-353f-42f2-9e18-c61d6dc6b776 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:23.694535 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-121079cd-353f-42f2-9e18-c61d6dc6b776 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:23.696916 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:54:23.703324 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-121079cd-353f-42f2-9e18-c61d6dc6b776 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:23.703814 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-121079cd-353f-42f2-9e18-c61d6dc6b776 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:23.704242 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-121079cd-353f-42f2-9e18-c61d6dc6b776 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:23.704929 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-121079cd-353f-42f2-9e18-c61d6dc6b776 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:23.705378 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-121079cd-353f-42f2-9e18-c61d6dc6b776 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:23.705832 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-121079cd-353f-42f2-9e18-c61d6dc6b776 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:23.831929 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-121079cd-353f-42f2-9e18-c61d6dc6b776 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:23.839782 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-121079cd-353f-42f2-9e18-c61d6dc6b776 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3" status: 200 len: 1511 microversion: 2.1 time: 0.149748 Oct 03 14:54:23.840343 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 165/358] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:23 2022] GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3 => generated 1511 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:24.863778 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-1e391a25-a61b-44b5-bc8d-ec945674e115 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:24.864406 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-1e391a25-a61b-44b5-bc8d-ec945674e115 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:24.870518 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1e391a25-a61b-44b5-bc8d-ec945674e115 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:24.871005 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1e391a25-a61b-44b5-bc8d-ec945674e115 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:24.871440 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1e391a25-a61b-44b5-bc8d-ec945674e115 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:24.872132 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1e391a25-a61b-44b5-bc8d-ec945674e115 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:24.872586 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1e391a25-a61b-44b5-bc8d-ec945674e115 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:24.873094 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1e391a25-a61b-44b5-bc8d-ec945674e115 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:24.999026 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-1e391a25-a61b-44b5-bc8d-ec945674e115 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:25.006471 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-1e391a25-a61b-44b5-bc8d-ec945674e115 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3" status: 200 len: 1511 microversion: 2.1 time: 0.146481 Oct 03 14:54:25.007028 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 194/359] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:24 2022] GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3 => generated 1511 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:26.028269 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-52c47685-e676-4d51-9f36-579c8e15cd2f tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:26.028813 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-52c47685-e676-4d51-9f36-579c8e15cd2f tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:26.035308 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-52c47685-e676-4d51-9f36-579c8e15cd2f tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:26.035797 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-52c47685-e676-4d51-9f36-579c8e15cd2f tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:26.036235 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-52c47685-e676-4d51-9f36-579c8e15cd2f tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:26.036927 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-52c47685-e676-4d51-9f36-579c8e15cd2f tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:26.037384 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-52c47685-e676-4d51-9f36-579c8e15cd2f tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:26.037844 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-52c47685-e676-4d51-9f36-579c8e15cd2f tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:26.167038 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-52c47685-e676-4d51-9f36-579c8e15cd2f tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:26.174793 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-52c47685-e676-4d51-9f36-579c8e15cd2f tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3" status: 200 len: 1511 microversion: 2.1 time: 0.150468 Oct 03 14:54:26.175357 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 166/360] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:26 2022] GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3 => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:27.197472 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-38353913-02ff-43d4-b985-e4262fb41006 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:27.198084 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-38353913-02ff-43d4-b985-e4262fb41006 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:27.204483 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-38353913-02ff-43d4-b985-e4262fb41006 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:27.204967 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-38353913-02ff-43d4-b985-e4262fb41006 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:27.205405 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-38353913-02ff-43d4-b985-e4262fb41006 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:27.206120 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-38353913-02ff-43d4-b985-e4262fb41006 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:27.206588 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-38353913-02ff-43d4-b985-e4262fb41006 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:27.207051 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-38353913-02ff-43d4-b985-e4262fb41006 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:27.338433 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-38353913-02ff-43d4-b985-e4262fb41006 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:27.346625 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-38353913-02ff-43d4-b985-e4262fb41006 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3" status: 200 len: 1511 microversion: 2.1 time: 0.152952 Oct 03 14:54:27.347181 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 195/361] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:27 2022] GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3 => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:28.369187 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-96cf06e2-7037-41f1-9697-0b8854504393 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:28.369940 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-96cf06e2-7037-41f1-9697-0b8854504393 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:28.376187 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-96cf06e2-7037-41f1-9697-0b8854504393 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:28.376688 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-96cf06e2-7037-41f1-9697-0b8854504393 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:28.377095 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-96cf06e2-7037-41f1-9697-0b8854504393 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:28.377820 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-96cf06e2-7037-41f1-9697-0b8854504393 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:28.378282 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-96cf06e2-7037-41f1-9697-0b8854504393 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:28.378712 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-96cf06e2-7037-41f1-9697-0b8854504393 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:28.504076 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-96cf06e2-7037-41f1-9697-0b8854504393 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:28.511597 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-96cf06e2-7037-41f1-9697-0b8854504393 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3" status: 200 len: 1511 microversion: 2.1 time: 0.146262 Oct 03 14:54:28.512154 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 167/362] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:28 2022] GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3 => generated 1511 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:29.533979 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-91677d33-e60e-4ca4-8ab0-5a1d0a42e7b3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:29.534549 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-91677d33-e60e-4ca4-8ab0-5a1d0a42e7b3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:29.540403 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-91677d33-e60e-4ca4-8ab0-5a1d0a42e7b3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:29.540877 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-91677d33-e60e-4ca4-8ab0-5a1d0a42e7b3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:29.541303 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-91677d33-e60e-4ca4-8ab0-5a1d0a42e7b3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:29.542011 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-91677d33-e60e-4ca4-8ab0-5a1d0a42e7b3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:29.542460 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-91677d33-e60e-4ca4-8ab0-5a1d0a42e7b3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:29.542877 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-91677d33-e60e-4ca4-8ab0-5a1d0a42e7b3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:29.674280 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-91677d33-e60e-4ca4-8ab0-5a1d0a42e7b3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:29.681938 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-91677d33-e60e-4ca4-8ab0-5a1d0a42e7b3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3" status: 200 len: 1511 microversion: 2.1 time: 0.151762 Oct 03 14:54:29.682503 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 196/363] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:29 2022] GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3 => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:30.706117 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-a27c8eaf-363d-4fe5-9de3-33f854e46218 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:30.706761 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-a27c8eaf-363d-4fe5-9de3-33f854e46218 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:30.713230 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a27c8eaf-363d-4fe5-9de3-33f854e46218 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:30.713744 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a27c8eaf-363d-4fe5-9de3-33f854e46218 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:30.714207 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a27c8eaf-363d-4fe5-9de3-33f854e46218 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:30.714949 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a27c8eaf-363d-4fe5-9de3-33f854e46218 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:30.715646 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a27c8eaf-363d-4fe5-9de3-33f854e46218 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:30.716094 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a27c8eaf-363d-4fe5-9de3-33f854e46218 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:30.850169 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-a27c8eaf-363d-4fe5-9de3-33f854e46218 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:30.858222 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-a27c8eaf-363d-4fe5-9de3-33f854e46218 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3" status: 200 len: 1517 microversion: 2.1 time: 0.156044 Oct 03 14:54:30.858774 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 168/364] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:30 2022] GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:32.219324 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-5c0c936c-20df-4dab-aea3-5d842d31c661 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Action: 'create', calling method: .version_select at 0x7fe0d35ba9d0>, body: {"keypair": {"name": "tempest-keypair-1928876236", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMLWIhL7WUUDdEEFdgxWghhcCvCSB05vfvYR40GmN7Stp32nwJhUaynPDuzF5vNA7dJg0YALCE7oSCqqP9hZwn2a5Hl73DUo85xd43WzH4F9bDR6eBraTzOpnurS/091GQ=="}} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:54:32.238619 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.quota [None req-5c0c936c-20df-4dab-aea3-5d842d31c661 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Getting quotas for project 83b495f3cb9b437d9572f4d33327fbf7. Resources: {'key_pairs'} {{(pid=126851) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:54:32.242332 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.quota [None req-5c0c936c-20df-4dab-aea3-5d842d31c661 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Getting quotas for user 335dd8706d4c402e98605479b57d059a and project 83b495f3cb9b437d9572f4d33327fbf7. Resources: {'key_pairs'} {{(pid=126851) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:54:32.277967 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-5c0c936c-20df-4dab-aea3-5d842d31c661 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.062610 Oct 03 14:54:32.278566 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 197/365] 10.222.0.46 () {60 vars in 1159 bytes} [Mon Oct 3 14:54:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:54:32.849329 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-8b4f81ef-66bb-45f6-9897-d92ea2fa2569 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1207366325", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-296655480", "security_groups": [{"name": "tempest-secgroup-smoke-2061145357"}], "block_device_mapping_v2": [{"uuid": "ccdfcf73-f64e-4af1-ba8e-6d96b819af2b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3cf2f742-adf1-4aae-8244-1e9578ee60b2"}]}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:54:32.969888 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.network.neutron [None req-8b4f81ef-66bb-45f6-9897-d92ea2fa2569 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] validate_networks() for [('3cf2f742-adf1-4aae-8244-1e9578ee60b2', None, None, None, None, None)] {{(pid=126852) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:54:33.346277 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-8b4f81ef-66bb-45f6-9897-d92ea2fa2569 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Flavor limits 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:54:33.346697 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-8b4f81ef-66bb-45f6-9897-d92ea2fa2569 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Image limits 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:54:33.347164 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-8b4f81ef-66bb-45f6-9897-d92ea2fa2569 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Flavor pref 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:54:33.347574 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-8b4f81ef-66bb-45f6-9897-d92ea2fa2569 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Image pref 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:54:33.347982 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-8b4f81ef-66bb-45f6-9897-d92ea2fa2569 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:54:33.356593 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8b4f81ef-66bb-45f6-9897-d92ea2fa2569 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:33.357070 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8b4f81ef-66bb-45f6-9897-d92ea2fa2569 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:33.357527 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8b4f81ef-66bb-45f6-9897-d92ea2fa2569 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:33.358258 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8b4f81ef-66bb-45f6-9897-d92ea2fa2569 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:33.358715 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8b4f81ef-66bb-45f6-9897-d92ea2fa2569 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:33.359138 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8b4f81ef-66bb-45f6-9897-d92ea2fa2569 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:33.375350 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-8b4f81ef-66bb-45f6-9897-d92ea2fa2569 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Getting quotas for project a167b2ccacbc4e6d903b09d9a00650fe. Resources: {'ram', 'instances', 'cores'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:54:33.379654 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-8b4f81ef-66bb-45f6-9897-d92ea2fa2569 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Getting quotas for user 7cfae014351641d8a949775875a45958 and project a167b2ccacbc4e6d903b09d9a00650fe. Resources: {'ram', 'instances', 'cores'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:54:33.436867 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-8b4f81ef-66bb-45f6-9897-d92ea2fa2569 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Going to run 1 instances... {{(pid=126852) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:54:33.439045 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-8b4f81ef-66bb-45f6-9897-d92ea2fa2569 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ccdfcf73-f64e-4af1-ba8e-6d96b819af2b',volume_size=None,volume_type=None)] {{(pid=126852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:54:33.579827 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-8b4f81ef-66bb-45f6-9897-d92ea2fa2569 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.734554 Oct 03 14:54:33.580805 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 169/366] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 3 14:54:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:54:33.591858 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-f96ed86e-a341-4f7f-a4bb-f71417a8b4f8 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:33.592632 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-f96ed86e-a341-4f7f-a4bb-f71417a8b4f8 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:33.602887 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-f00327ac-fe9d-47b6-94aa-6295fa8508e6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-183546246", "imageRef": "add7a872-2ca1-4366-9a93-f0663fdb297b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a4c53322-c54a-4ca9-801c-f9a07dbbe7a2"}], "security_groups": [{"name": "tempest-securitygroup--1025488920"}], "key_name": "tempest-keypair-1928876236", "user_data": "}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:54:33.657295 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-f96ed86e-a341-4f7f-a4bb-f71417a8b4f8 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:33.664858 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-f96ed86e-a341-4f7f-a4bb-f71417a8b4f8 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 200 len: 1094 microversion: 2.1 time: 0.077191 Oct 03 14:54:33.665547 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 198/367] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:33 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:33.717889 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.network.neutron [None req-f00327ac-fe9d-47b6-94aa-6295fa8508e6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] validate_networks() for [('a4c53322-c54a-4ca9-801c-f9a07dbbe7a2', None, None, None, None, None)] {{(pid=126852) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:54:34.279618 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-f00327ac-fe9d-47b6-94aa-6295fa8508e6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Flavor limits 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:54:34.280698 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-f00327ac-fe9d-47b6-94aa-6295fa8508e6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Image limits 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:54:34.281471 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-f00327ac-fe9d-47b6-94aa-6295fa8508e6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Flavor pref 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:54:34.282447 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-f00327ac-fe9d-47b6-94aa-6295fa8508e6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Image pref 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:54:34.282921 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-f00327ac-fe9d-47b6-94aa-6295fa8508e6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:54:34.292774 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f00327ac-fe9d-47b6-94aa-6295fa8508e6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:34.293548 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f00327ac-fe9d-47b6-94aa-6295fa8508e6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:34.294174 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f00327ac-fe9d-47b6-94aa-6295fa8508e6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:34.295664 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f00327ac-fe9d-47b6-94aa-6295fa8508e6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:34.296301 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f00327ac-fe9d-47b6-94aa-6295fa8508e6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:34.296916 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f00327ac-fe9d-47b6-94aa-6295fa8508e6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:34.318250 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-f00327ac-fe9d-47b6-94aa-6295fa8508e6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Getting quotas for project 83b495f3cb9b437d9572f4d33327fbf7. Resources: {'ram', 'instances', 'cores'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:54:34.325464 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-f00327ac-fe9d-47b6-94aa-6295fa8508e6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Getting quotas for user 335dd8706d4c402e98605479b57d059a and project 83b495f3cb9b437d9572f4d33327fbf7. Resources: {'ram', 'instances', 'cores'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:54:34.343516 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-f00327ac-fe9d-47b6-94aa-6295fa8508e6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Going to run 1 instances... {{(pid=126852) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:54:34.346694 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-f00327ac-fe9d-47b6-94aa-6295fa8508e6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='add7a872-2ca1-4366-9a93-f0663fdb297b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:54:34.408747 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-f00327ac-fe9d-47b6-94aa-6295fa8508e6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.810843 Oct 03 14:54:34.410248 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 170/368] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 3 14:54:33 2022] POST /compute/v2.1/servers => generated 409 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:54:34.421581 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-29e8182f-d59e-449e-a31f-2c7d97d32e7e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:34.422201 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-29e8182f-d59e-449e-a31f-2c7d97d32e7e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:34.535067 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-29e8182f-d59e-449e-a31f-2c7d97d32e7e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:34.543882 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-29e8182f-d59e-449e-a31f-2c7d97d32e7e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1245 microversion: 2.1 time: 0.126035 Oct 03 14:54:34.544196 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 199/369] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:34 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1245 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:34.688698 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-8f5f659b-535a-4e0c-bc21-ecfd51f03ed1 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:34.689615 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-8f5f659b-535a-4e0c-bc21-ecfd51f03ed1 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:34.699552 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8f5f659b-535a-4e0c-bc21-ecfd51f03ed1 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:34.702523 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8f5f659b-535a-4e0c-bc21-ecfd51f03ed1 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:34.702832 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8f5f659b-535a-4e0c-bc21-ecfd51f03ed1 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:34.714346 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8f5f659b-535a-4e0c-bc21-ecfd51f03ed1 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:34.714739 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8f5f659b-535a-4e0c-bc21-ecfd51f03ed1 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:34.715262 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8f5f659b-535a-4e0c-bc21-ecfd51f03ed1 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:34.806168 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-8f5f659b-535a-4e0c-bc21-ecfd51f03ed1 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:34.827189 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-8f5f659b-535a-4e0c-bc21-ecfd51f03ed1 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 200 len: 1192 microversion: 2.1 time: 0.141703 Oct 03 14:54:34.827920 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 171/370] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:34 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 1192 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:54:35.568359 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-a110d479-4a0e-4a3b-97a5-49f8a5bcce3e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:35.569735 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-a110d479-4a0e-4a3b-97a5-49f8a5bcce3e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:35.580095 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a110d479-4a0e-4a3b-97a5-49f8a5bcce3e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:35.580599 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a110d479-4a0e-4a3b-97a5-49f8a5bcce3e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:35.581036 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a110d479-4a0e-4a3b-97a5-49f8a5bcce3e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:35.581794 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a110d479-4a0e-4a3b-97a5-49f8a5bcce3e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:35.582248 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a110d479-4a0e-4a3b-97a5-49f8a5bcce3e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:35.582678 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a110d479-4a0e-4a3b-97a5-49f8a5bcce3e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:35.686686 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-a110d479-4a0e-4a3b-97a5-49f8a5bcce3e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:35.695990 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-a110d479-4a0e-4a3b-97a5-49f8a5bcce3e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1297 microversion: 2.1 time: 0.131643 Oct 03 14:54:35.711023 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 200/371] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:35 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1297 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:35.852101 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-c1af14ad-0a83-4402-ad32-c624a733b68c tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:35.853833 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-c1af14ad-0a83-4402-ad32-c624a733b68c tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:35.864017 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c1af14ad-0a83-4402-ad32-c624a733b68c tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:35.864748 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c1af14ad-0a83-4402-ad32-c624a733b68c tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:35.865452 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c1af14ad-0a83-4402-ad32-c624a733b68c tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:35.866611 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c1af14ad-0a83-4402-ad32-c624a733b68c tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:35.867416 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c1af14ad-0a83-4402-ad32-c624a733b68c tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:35.868741 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c1af14ad-0a83-4402-ad32-c624a733b68c tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:35.874995 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:54:35.976496 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-c1af14ad-0a83-4402-ad32-c624a733b68c tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:35.989221 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-c1af14ad-0a83-4402-ad32-c624a733b68c tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 200 len: 1210 microversion: 2.1 time: 0.141466 Oct 03 14:54:35.990152 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 172/372] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:35 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 1210 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:36.726946 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-37499e40-4051-4ff6-a668-ddbb8b4428c7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:36.727556 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-37499e40-4051-4ff6-a668-ddbb8b4428c7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:36.734483 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-37499e40-4051-4ff6-a668-ddbb8b4428c7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:36.734972 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-37499e40-4051-4ff6-a668-ddbb8b4428c7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:36.735403 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-37499e40-4051-4ff6-a668-ddbb8b4428c7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:36.736376 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-37499e40-4051-4ff6-a668-ddbb8b4428c7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:36.736839 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-37499e40-4051-4ff6-a668-ddbb8b4428c7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:36.737324 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-37499e40-4051-4ff6-a668-ddbb8b4428c7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:36.742150 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=77 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:54:36.816839 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-37499e40-4051-4ff6-a668-ddbb8b4428c7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:36.825609 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-37499e40-4051-4ff6-a668-ddbb8b4428c7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1303 microversion: 2.1 time: 0.102321 Oct 03 14:54:36.826351 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 201/373] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:36 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:37.016362 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-51f3a418-d121-4e9a-980d-79582080b8ad tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:37.017781 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-51f3a418-d121-4e9a-980d-79582080b8ad tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:37.025395 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-51f3a418-d121-4e9a-980d-79582080b8ad tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:37.026360 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-51f3a418-d121-4e9a-980d-79582080b8ad tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:37.026737 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-51f3a418-d121-4e9a-980d-79582080b8ad tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:37.027663 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-51f3a418-d121-4e9a-980d-79582080b8ad tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:37.028348 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-51f3a418-d121-4e9a-980d-79582080b8ad tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:37.029670 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-51f3a418-d121-4e9a-980d-79582080b8ad tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:37.176749 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-8da1d1b2-586d-4e2f-a567-7f9fbdb61d50 req-2173431a-ce87-4c09-9891-a900dae09727 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8565107e-de79-4c29-a92d-0dcc47cdaad4", "tag": "844f2524-468f-4861-a833-34bb9a1e4138"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:54:37.194396 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-8da1d1b2-586d-4e2f-a567-7f9fbdb61d50 req-2173431a-ce87-4c09-9891-a900dae09727 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:37.195487 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-8da1d1b2-586d-4e2f-a567-7f9fbdb61d50 req-2173431a-ce87-4c09-9891-a900dae09727 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:37.196155 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-8da1d1b2-586d-4e2f-a567-7f9fbdb61d50 req-2173431a-ce87-4c09-9891-a900dae09727 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:37.211167 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-8da1d1b2-586d-4e2f-a567-7f9fbdb61d50 req-2173431a-ce87-4c09-9891-a900dae09727 service nova] Creating event network-changed:844f2524-468f-4861-a833-34bb9a1e4138 for instance 8565107e-de79-4c29-a92d-0dcc47cdaad4 on hv-cinder-85987 Oct 03 14:54:37.217253 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-8da1d1b2-586d-4e2f-a567-7f9fbdb61d50 req-2173431a-ce87-4c09-9891-a900dae09727 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044311 Oct 03 14:54:37.218352 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 202/374] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:54:37.365871 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-51f3a418-d121-4e9a-980d-79582080b8ad tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:37.391588 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-51f3a418-d121-4e9a-980d-79582080b8ad tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 200 len: 1266 microversion: 2.1 time: 0.379656 Oct 03 14:54:37.406668 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 173/375] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:37 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 1266 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:54:37.849846 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-095a9945-05eb-4133-8d1b-e63d4f4bbbc5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:37.851337 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-095a9945-05eb-4133-8d1b-e63d4f4bbbc5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:37.866622 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-095a9945-05eb-4133-8d1b-e63d4f4bbbc5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:37.867553 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-095a9945-05eb-4133-8d1b-e63d4f4bbbc5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:37.867987 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-095a9945-05eb-4133-8d1b-e63d4f4bbbc5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:37.869149 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-095a9945-05eb-4133-8d1b-e63d4f4bbbc5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:37.873305 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-095a9945-05eb-4133-8d1b-e63d4f4bbbc5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:37.875111 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-095a9945-05eb-4133-8d1b-e63d4f4bbbc5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:38.117812 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-095a9945-05eb-4133-8d1b-e63d4f4bbbc5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:38.130852 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-095a9945-05eb-4133-8d1b-e63d4f4bbbc5 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1371 microversion: 2.1 time: 0.284262 Oct 03 14:54:38.131943 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 203/376] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:37 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1371 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:38.416986 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-e56f24d8-46ba-401f-b1df-e2ed6baf39bb tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:38.418518 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-e56f24d8-46ba-401f-b1df-e2ed6baf39bb tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:38.426277 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e56f24d8-46ba-401f-b1df-e2ed6baf39bb tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:38.427130 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e56f24d8-46ba-401f-b1df-e2ed6baf39bb tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:38.427882 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e56f24d8-46ba-401f-b1df-e2ed6baf39bb tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:38.428976 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e56f24d8-46ba-401f-b1df-e2ed6baf39bb tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:38.429926 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e56f24d8-46ba-401f-b1df-e2ed6baf39bb tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:38.430544 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e56f24d8-46ba-401f-b1df-e2ed6baf39bb tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:38.765718 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-e56f24d8-46ba-401f-b1df-e2ed6baf39bb tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:38.775735 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-e56f24d8-46ba-401f-b1df-e2ed6baf39bb tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 200 len: 1266 microversion: 2.1 time: 0.362925 Oct 03 14:54:38.776445 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 174/377] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:38 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 1266 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:39.010460 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-f215f154-aebf-4e94-a1a1-a9819e80fdea req-8ef67683-fc45-4fb4-ba93-d81f65a36cec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a42b833-728b-44e8-af21-fe86e25c035f", "tag": "71f04a2e-59ac-4427-96fb-90ece95bcbde"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:54:39.020468 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-f215f154-aebf-4e94-a1a1-a9819e80fdea req-8ef67683-fc45-4fb4-ba93-d81f65a36cec service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:39.020941 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-f215f154-aebf-4e94-a1a1-a9819e80fdea req-8ef67683-fc45-4fb4-ba93-d81f65a36cec service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:39.021367 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-f215f154-aebf-4e94-a1a1-a9819e80fdea req-8ef67683-fc45-4fb4-ba93-d81f65a36cec service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:39.033598 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-f215f154-aebf-4e94-a1a1-a9819e80fdea req-8ef67683-fc45-4fb4-ba93-d81f65a36cec service nova] Creating event network-changed:71f04a2e-59ac-4427-96fb-90ece95bcbde for instance 3a42b833-728b-44e8-af21-fe86e25c035f on hv-cinder-85987 Oct 03 14:54:39.038931 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-f215f154-aebf-4e94-a1a1-a9819e80fdea req-8ef67683-fc45-4fb4-ba93-d81f65a36cec service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032752 Oct 03 14:54:39.039528 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 204/378] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:54:39.154229 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-04fd020c-154a-4d75-9853-d400ec2ff500 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:39.154840 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-04fd020c-154a-4d75-9853-d400ec2ff500 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:39.160640 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-04fd020c-154a-4d75-9853-d400ec2ff500 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:39.161119 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-04fd020c-154a-4d75-9853-d400ec2ff500 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:39.161580 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-04fd020c-154a-4d75-9853-d400ec2ff500 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:39.162532 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-04fd020c-154a-4d75-9853-d400ec2ff500 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:39.162985 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-04fd020c-154a-4d75-9853-d400ec2ff500 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:39.163405 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-04fd020c-154a-4d75-9853-d400ec2ff500 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:39.299403 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-04fd020c-154a-4d75-9853-d400ec2ff500 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:39.307230 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-04fd020c-154a-4d75-9853-d400ec2ff500 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1371 microversion: 2.1 time: 0.156883 Oct 03 14:54:39.314527 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 175/379] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:39 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:39.799940 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-38f9ca04-a0c0-4a52-9e6e-9a31744598ff tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:39.800730 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-38f9ca04-a0c0-4a52-9e6e-9a31744598ff tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:39.807037 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-38f9ca04-a0c0-4a52-9e6e-9a31744598ff tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:39.807545 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-38f9ca04-a0c0-4a52-9e6e-9a31744598ff tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:39.807983 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-38f9ca04-a0c0-4a52-9e6e-9a31744598ff tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:39.808676 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-38f9ca04-a0c0-4a52-9e6e-9a31744598ff tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:39.809129 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-38f9ca04-a0c0-4a52-9e6e-9a31744598ff tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:39.810456 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-38f9ca04-a0c0-4a52-9e6e-9a31744598ff tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:40.047443 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-38f9ca04-a0c0-4a52-9e6e-9a31744598ff tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:40.070432 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-38f9ca04-a0c0-4a52-9e6e-9a31744598ff tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 200 len: 1266 microversion: 2.1 time: 0.274857 Oct 03 14:54:40.071853 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 205/380] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:39 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 1266 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:40.330859 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-3f80659e-78f6-4f5d-8966-9335678f23f2 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:40.331470 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-3f80659e-78f6-4f5d-8966-9335678f23f2 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:40.338189 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3f80659e-78f6-4f5d-8966-9335678f23f2 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:40.338672 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3f80659e-78f6-4f5d-8966-9335678f23f2 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:40.339108 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3f80659e-78f6-4f5d-8966-9335678f23f2 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:40.339807 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3f80659e-78f6-4f5d-8966-9335678f23f2 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:40.340519 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3f80659e-78f6-4f5d-8966-9335678f23f2 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:40.340947 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3f80659e-78f6-4f5d-8966-9335678f23f2 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:40.465045 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-3f80659e-78f6-4f5d-8966-9335678f23f2 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:40.473775 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-3f80659e-78f6-4f5d-8966-9335678f23f2 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1371 microversion: 2.1 time: 0.147391 Oct 03 14:54:40.474343 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 176/381] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:40 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:41.097335 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-641fb8a3-c5ee-4975-89d4-81f41145a95b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:41.097963 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-641fb8a3-c5ee-4975-89d4-81f41145a95b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:41.103723 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-641fb8a3-c5ee-4975-89d4-81f41145a95b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:41.104201 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-641fb8a3-c5ee-4975-89d4-81f41145a95b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:41.104627 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-641fb8a3-c5ee-4975-89d4-81f41145a95b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:41.105314 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-641fb8a3-c5ee-4975-89d4-81f41145a95b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:41.105792 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-641fb8a3-c5ee-4975-89d4-81f41145a95b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:41.106246 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-641fb8a3-c5ee-4975-89d4-81f41145a95b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:41.496364 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-bea71352-27c5-46f0-81ee-c3b7c798caae tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:41.497070 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-bea71352-27c5-46f0-81ee-c3b7c798caae tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:41.504379 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bea71352-27c5-46f0-81ee-c3b7c798caae tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:41.504927 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bea71352-27c5-46f0-81ee-c3b7c798caae tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:41.505418 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bea71352-27c5-46f0-81ee-c3b7c798caae tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:41.506197 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bea71352-27c5-46f0-81ee-c3b7c798caae tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:41.506659 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bea71352-27c5-46f0-81ee-c3b7c798caae tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:41.507088 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bea71352-27c5-46f0-81ee-c3b7c798caae tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:41.508149 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-641fb8a3-c5ee-4975-89d4-81f41145a95b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:41.516669 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-641fb8a3-c5ee-4975-89d4-81f41145a95b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 200 len: 1266 microversion: 2.1 time: 0.423127 Oct 03 14:54:41.517263 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 206/382] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:41 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 1266 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:41.641637 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-bea71352-27c5-46f0-81ee-c3b7c798caae tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:41.649551 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-bea71352-27c5-46f0-81ee-c3b7c798caae tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1371 microversion: 2.1 time: 0.157084 Oct 03 14:54:41.650113 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 177/383] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:41 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:54:42.538989 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-bd9bc240-af35-4805-8084-dfad29950154 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:42.539598 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-bd9bc240-af35-4805-8084-dfad29950154 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:42.541618 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:54:42.548194 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bd9bc240-af35-4805-8084-dfad29950154 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:42.548621 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bd9bc240-af35-4805-8084-dfad29950154 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:42.549054 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bd9bc240-af35-4805-8084-dfad29950154 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:42.549774 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bd9bc240-af35-4805-8084-dfad29950154 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:42.550372 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bd9bc240-af35-4805-8084-dfad29950154 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:42.550799 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bd9bc240-af35-4805-8084-dfad29950154 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:42.672952 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-88db9bee-393d-480a-b412-f4ff666377e8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:42.673664 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-88db9bee-393d-480a-b412-f4ff666377e8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:42.679993 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-88db9bee-393d-480a-b412-f4ff666377e8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:42.680483 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-88db9bee-393d-480a-b412-f4ff666377e8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:42.680920 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-88db9bee-393d-480a-b412-f4ff666377e8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:42.681646 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-88db9bee-393d-480a-b412-f4ff666377e8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:42.682107 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-88db9bee-393d-480a-b412-f4ff666377e8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:42.682531 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-88db9bee-393d-480a-b412-f4ff666377e8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:42.691823 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-bd9bc240-af35-4805-8084-dfad29950154 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:42.699656 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-bd9bc240-af35-4805-8084-dfad29950154 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 200 len: 1266 microversion: 2.1 time: 0.164510 Oct 03 14:54:42.700329 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 207/384] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:42 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:42.810536 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-88db9bee-393d-480a-b412-f4ff666377e8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:42.818618 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-88db9bee-393d-480a-b412-f4ff666377e8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1371 microversion: 2.1 time: 0.150270 Oct 03 14:54:42.819200 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 178/385] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:42 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:43.722267 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-2db34801-e120-4b94-afba-6e1dc718db40 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:43.722902 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-2db34801-e120-4b94-afba-6e1dc718db40 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:43.728764 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2db34801-e120-4b94-afba-6e1dc718db40 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:43.729244 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2db34801-e120-4b94-afba-6e1dc718db40 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:43.729719 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2db34801-e120-4b94-afba-6e1dc718db40 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:43.730405 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2db34801-e120-4b94-afba-6e1dc718db40 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:43.730859 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2db34801-e120-4b94-afba-6e1dc718db40 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:43.731288 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2db34801-e120-4b94-afba-6e1dc718db40 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:43.842004 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-8cb93d02-6bbc-41ed-a328-7b4d44e51e6c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:43.842621 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-8cb93d02-6bbc-41ed-a328-7b4d44e51e6c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:43.848953 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8cb93d02-6bbc-41ed-a328-7b4d44e51e6c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:43.849437 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8cb93d02-6bbc-41ed-a328-7b4d44e51e6c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:43.849903 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8cb93d02-6bbc-41ed-a328-7b4d44e51e6c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:43.850590 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8cb93d02-6bbc-41ed-a328-7b4d44e51e6c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:43.851041 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8cb93d02-6bbc-41ed-a328-7b4d44e51e6c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:43.851465 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8cb93d02-6bbc-41ed-a328-7b4d44e51e6c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:43.861598 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-2db34801-e120-4b94-afba-6e1dc718db40 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:43.869146 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-2db34801-e120-4b94-afba-6e1dc718db40 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 200 len: 1266 microversion: 2.1 time: 0.150816 Oct 03 14:54:43.869767 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 208/386] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:43 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:43.982130 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-8cb93d02-6bbc-41ed-a328-7b4d44e51e6c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:43.990358 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-8cb93d02-6bbc-41ed-a328-7b4d44e51e6c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1371 microversion: 2.1 time: 0.152464 Oct 03 14:54:43.990927 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 179/387] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:43 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:54:44.892751 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-0220238d-607b-4294-a955-1be88e0453b1 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:44.893367 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-0220238d-607b-4294-a955-1be88e0453b1 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:44.895246 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell0:SELECT=8 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:54:44.900603 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0220238d-607b-4294-a955-1be88e0453b1 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:44.901084 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0220238d-607b-4294-a955-1be88e0453b1 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:44.901550 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0220238d-607b-4294-a955-1be88e0453b1 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:44.902243 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0220238d-607b-4294-a955-1be88e0453b1 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:44.902699 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0220238d-607b-4294-a955-1be88e0453b1 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:44.903124 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0220238d-607b-4294-a955-1be88e0453b1 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:45.015123 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-6a28957f-f87b-4418-8abd-259040baa889 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:45.015730 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-6a28957f-f87b-4418-8abd-259040baa889 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:45.017605 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell0:SELECT=4 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:54:45.018404 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell0:SELECT=12 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:54:45.024716 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6a28957f-f87b-4418-8abd-259040baa889 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:45.025206 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6a28957f-f87b-4418-8abd-259040baa889 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:45.025674 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6a28957f-f87b-4418-8abd-259040baa889 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:45.026379 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6a28957f-f87b-4418-8abd-259040baa889 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:45.026838 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6a28957f-f87b-4418-8abd-259040baa889 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:45.027268 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6a28957f-f87b-4418-8abd-259040baa889 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:45.034376 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-0220238d-607b-4294-a955-1be88e0453b1 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:45.042009 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-0220238d-607b-4294-a955-1be88e0453b1 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 200 len: 1266 microversion: 2.1 time: 0.153730 Oct 03 14:54:45.042597 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 209/388] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:44 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:45.155442 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-6a28957f-f87b-4418-8abd-259040baa889 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:45.163167 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-6a28957f-f87b-4418-8abd-259040baa889 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1371 microversion: 2.1 time: 0.152591 Oct 03 14:54:45.163729 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 180/389] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:45 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:54:46.064635 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-be7ccc64-9a2a-441f-b06c-d08322a78da6 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:46.065193 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-be7ccc64-9a2a-441f-b06c-d08322a78da6 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:46.071087 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-be7ccc64-9a2a-441f-b06c-d08322a78da6 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:46.071563 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-be7ccc64-9a2a-441f-b06c-d08322a78da6 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:46.071988 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-be7ccc64-9a2a-441f-b06c-d08322a78da6 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:46.072663 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-be7ccc64-9a2a-441f-b06c-d08322a78da6 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:46.073113 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-be7ccc64-9a2a-441f-b06c-d08322a78da6 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:46.073550 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-be7ccc64-9a2a-441f-b06c-d08322a78da6 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:46.186465 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-4c84717f-3066-4e11-b352-f1e99a6642db tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:46.187062 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-4c84717f-3066-4e11-b352-f1e99a6642db tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:46.193370 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4c84717f-3066-4e11-b352-f1e99a6642db tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:46.193888 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4c84717f-3066-4e11-b352-f1e99a6642db tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:46.194328 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4c84717f-3066-4e11-b352-f1e99a6642db tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:46.195016 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4c84717f-3066-4e11-b352-f1e99a6642db tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:46.195464 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4c84717f-3066-4e11-b352-f1e99a6642db tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:46.195882 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4c84717f-3066-4e11-b352-f1e99a6642db tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:46.208730 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-be7ccc64-9a2a-441f-b06c-d08322a78da6 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:46.216974 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-be7ccc64-9a2a-441f-b06c-d08322a78da6 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 200 len: 1266 microversion: 2.1 time: 0.155971 Oct 03 14:54:46.217557 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 210/390] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:46 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:46.328201 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-4c84717f-3066-4e11-b352-f1e99a6642db tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:46.335765 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-4c84717f-3066-4e11-b352-f1e99a6642db tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1371 microversion: 2.1 time: 0.153624 Oct 03 14:54:46.336322 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 181/391] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:46 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:54:47.239537 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-22c8c76e-8a67-4df5-9351-72cdf2fca352 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:47.240179 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-22c8c76e-8a67-4df5-9351-72cdf2fca352 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:47.246135 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-22c8c76e-8a67-4df5-9351-72cdf2fca352 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:47.246613 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-22c8c76e-8a67-4df5-9351-72cdf2fca352 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:47.247048 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-22c8c76e-8a67-4df5-9351-72cdf2fca352 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:47.247729 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-22c8c76e-8a67-4df5-9351-72cdf2fca352 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:47.248181 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-22c8c76e-8a67-4df5-9351-72cdf2fca352 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:47.248600 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-22c8c76e-8a67-4df5-9351-72cdf2fca352 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:47.358701 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-425eecfe-07b6-430b-9bc8-c92eb402d5d0 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:47.359320 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-425eecfe-07b6-430b-9bc8-c92eb402d5d0 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:47.365564 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-425eecfe-07b6-430b-9bc8-c92eb402d5d0 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:47.366053 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-425eecfe-07b6-430b-9bc8-c92eb402d5d0 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:47.366491 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-425eecfe-07b6-430b-9bc8-c92eb402d5d0 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:47.367178 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-425eecfe-07b6-430b-9bc8-c92eb402d5d0 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:47.367637 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-425eecfe-07b6-430b-9bc8-c92eb402d5d0 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:47.368060 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-425eecfe-07b6-430b-9bc8-c92eb402d5d0 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:47.375180 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-22c8c76e-8a67-4df5-9351-72cdf2fca352 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:47.382731 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-22c8c76e-8a67-4df5-9351-72cdf2fca352 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 200 len: 1266 microversion: 2.1 time: 0.147037 Oct 03 14:54:47.383293 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 211/392] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:47 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:47.494521 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-425eecfe-07b6-430b-9bc8-c92eb402d5d0 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:47.502232 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-425eecfe-07b6-430b-9bc8-c92eb402d5d0 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1371 microversion: 2.1 time: 0.147353 Oct 03 14:54:47.502799 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 182/393] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:47 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:48.405358 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-64c6affa-1729-4a62-acd7-5a81e56951e8 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:48.405994 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-64c6affa-1729-4a62-acd7-5a81e56951e8 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:48.411824 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-64c6affa-1729-4a62-acd7-5a81e56951e8 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:48.412313 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-64c6affa-1729-4a62-acd7-5a81e56951e8 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:48.412743 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-64c6affa-1729-4a62-acd7-5a81e56951e8 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:48.413421 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-64c6affa-1729-4a62-acd7-5a81e56951e8 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:48.413965 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-64c6affa-1729-4a62-acd7-5a81e56951e8 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:48.414382 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-64c6affa-1729-4a62-acd7-5a81e56951e8 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:48.524756 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-aca02618-cd47-4632-95e3-329cc9b4c849 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:48.525359 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-aca02618-cd47-4632-95e3-329cc9b4c849 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:48.531993 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-aca02618-cd47-4632-95e3-329cc9b4c849 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:48.532407 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-aca02618-cd47-4632-95e3-329cc9b4c849 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:48.532834 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-aca02618-cd47-4632-95e3-329cc9b4c849 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:48.533534 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-aca02618-cd47-4632-95e3-329cc9b4c849 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:48.533985 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-aca02618-cd47-4632-95e3-329cc9b4c849 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:48.534422 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-aca02618-cd47-4632-95e3-329cc9b4c849 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:48.542029 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-64c6affa-1729-4a62-acd7-5a81e56951e8 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:48.550169 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-64c6affa-1729-4a62-acd7-5a81e56951e8 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 200 len: 1266 microversion: 2.1 time: 0.148615 Oct 03 14:54:48.550735 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 212/394] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:48 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:48.662611 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-aca02618-cd47-4632-95e3-329cc9b4c849 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:48.670709 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-aca02618-cd47-4632-95e3-329cc9b4c849 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1371 microversion: 2.1 time: 0.150527 Oct 03 14:54:48.671267 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 183/395] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:48 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:54:49.572499 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-6b2728be-7187-4f63-90db-37f19fd5472f tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:49.573185 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-6b2728be-7187-4f63-90db-37f19fd5472f tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:49.579542 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6b2728be-7187-4f63-90db-37f19fd5472f tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:49.580019 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6b2728be-7187-4f63-90db-37f19fd5472f tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:49.580447 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6b2728be-7187-4f63-90db-37f19fd5472f tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:49.581123 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6b2728be-7187-4f63-90db-37f19fd5472f tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:49.581595 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6b2728be-7187-4f63-90db-37f19fd5472f tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:49.582012 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6b2728be-7187-4f63-90db-37f19fd5472f tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:49.692473 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-926f51c8-84a7-42cd-a202-8639ba307f47 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:49.693077 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-926f51c8-84a7-42cd-a202-8639ba307f47 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:49.699647 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-926f51c8-84a7-42cd-a202-8639ba307f47 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:49.700126 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-926f51c8-84a7-42cd-a202-8639ba307f47 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:49.700687 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-926f51c8-84a7-42cd-a202-8639ba307f47 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:49.701401 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-926f51c8-84a7-42cd-a202-8639ba307f47 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:49.701872 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-926f51c8-84a7-42cd-a202-8639ba307f47 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:49.702289 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-926f51c8-84a7-42cd-a202-8639ba307f47 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:49.712250 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-6b2728be-7187-4f63-90db-37f19fd5472f tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:49.720099 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-6b2728be-7187-4f63-90db-37f19fd5472f tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 200 len: 1266 microversion: 2.1 time: 0.151384 Oct 03 14:54:49.720943 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 213/396] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:49 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:49.831503 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-926f51c8-84a7-42cd-a202-8639ba307f47 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:49.839025 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-926f51c8-84a7-42cd-a202-8639ba307f47 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1371 microversion: 2.1 time: 0.150489 Oct 03 14:54:49.839578 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 184/397] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:49 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:50.742830 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-96710c72-6cf9-489b-94da-553762f2d880 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:50.743434 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-96710c72-6cf9-489b-94da-553762f2d880 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:50.749251 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-96710c72-6cf9-489b-94da-553762f2d880 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:50.749779 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-96710c72-6cf9-489b-94da-553762f2d880 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:50.750207 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-96710c72-6cf9-489b-94da-553762f2d880 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:50.750920 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-96710c72-6cf9-489b-94da-553762f2d880 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:50.751369 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-96710c72-6cf9-489b-94da-553762f2d880 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:50.751786 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-96710c72-6cf9-489b-94da-553762f2d880 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:50.862242 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-cd880cb5-c75f-4dfa-b941-fc7396998883 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:50.863063 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-cd880cb5-c75f-4dfa-b941-fc7396998883 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:50.869847 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cd880cb5-c75f-4dfa-b941-fc7396998883 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:50.870423 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cd880cb5-c75f-4dfa-b941-fc7396998883 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:50.871032 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cd880cb5-c75f-4dfa-b941-fc7396998883 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:50.871921 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cd880cb5-c75f-4dfa-b941-fc7396998883 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:50.877615 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cd880cb5-c75f-4dfa-b941-fc7396998883 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:50.877615 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cd880cb5-c75f-4dfa-b941-fc7396998883 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:50.891343 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-96710c72-6cf9-489b-94da-553762f2d880 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:50.899579 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-96710c72-6cf9-489b-94da-553762f2d880 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 200 len: 1266 microversion: 2.1 time: 0.160396 Oct 03 14:54:50.900146 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 214/398] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:50 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:51.019227 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-cd880cb5-c75f-4dfa-b941-fc7396998883 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:51.026837 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-cd880cb5-c75f-4dfa-b941-fc7396998883 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1371 microversion: 2.1 time: 0.168652 Oct 03 14:54:51.027693 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 185/399] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:50 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:54:51.923168 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-8772efed-a7f1-4ecb-b0fd-a0adcfb749b4 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:51.923707 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-8772efed-a7f1-4ecb-b0fd-a0adcfb749b4 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:51.929693 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8772efed-a7f1-4ecb-b0fd-a0adcfb749b4 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:51.930175 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8772efed-a7f1-4ecb-b0fd-a0adcfb749b4 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:51.930605 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8772efed-a7f1-4ecb-b0fd-a0adcfb749b4 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:51.931293 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8772efed-a7f1-4ecb-b0fd-a0adcfb749b4 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:51.931750 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8772efed-a7f1-4ecb-b0fd-a0adcfb749b4 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:51.932172 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8772efed-a7f1-4ecb-b0fd-a0adcfb749b4 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:52.051149 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-8384dfdb-e85a-4569-b2df-2e72849c501b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:52.051779 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-8384dfdb-e85a-4569-b2df-2e72849c501b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:52.058066 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8384dfdb-e85a-4569-b2df-2e72849c501b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:52.058549 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8384dfdb-e85a-4569-b2df-2e72849c501b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:52.058979 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8384dfdb-e85a-4569-b2df-2e72849c501b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:52.059669 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8384dfdb-e85a-4569-b2df-2e72849c501b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:52.060172 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8384dfdb-e85a-4569-b2df-2e72849c501b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:52.061032 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-8772efed-a7f1-4ecb-b0fd-a0adcfb749b4 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:52.061152 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8384dfdb-e85a-4569-b2df-2e72849c501b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:52.068862 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-8772efed-a7f1-4ecb-b0fd-a0adcfb749b4 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 200 len: 1266 microversion: 2.1 time: 0.150146 Oct 03 14:54:52.069427 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 215/400] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:51 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:52.189800 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-8384dfdb-e85a-4569-b2df-2e72849c501b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:52.197235 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-8384dfdb-e85a-4569-b2df-2e72849c501b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1371 microversion: 2.1 time: 0.149903 Oct 03 14:54:52.197826 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 186/401] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:52 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:54:53.091658 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-2f54efb0-ae43-4835-9ae2-abb482496542 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:53.092184 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-2f54efb0-ae43-4835-9ae2-abb482496542 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:53.098096 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2f54efb0-ae43-4835-9ae2-abb482496542 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:53.098583 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2f54efb0-ae43-4835-9ae2-abb482496542 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:53.099014 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2f54efb0-ae43-4835-9ae2-abb482496542 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:53.099698 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2f54efb0-ae43-4835-9ae2-abb482496542 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:53.100154 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2f54efb0-ae43-4835-9ae2-abb482496542 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:53.100577 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2f54efb0-ae43-4835-9ae2-abb482496542 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:53.219904 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-ff11dd49-cb87-4648-8995-9fe45557b76b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:53.220656 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-ff11dd49-cb87-4648-8995-9fe45557b76b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:53.227083 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ff11dd49-cb87-4648-8995-9fe45557b76b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:53.227464 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ff11dd49-cb87-4648-8995-9fe45557b76b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:53.227894 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ff11dd49-cb87-4648-8995-9fe45557b76b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:53.228605 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ff11dd49-cb87-4648-8995-9fe45557b76b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:53.229059 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ff11dd49-cb87-4648-8995-9fe45557b76b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:53.229365 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-2f54efb0-ae43-4835-9ae2-abb482496542 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:53.229476 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ff11dd49-cb87-4648-8995-9fe45557b76b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:53.237764 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-2f54efb0-ae43-4835-9ae2-abb482496542 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 200 len: 1266 microversion: 2.1 time: 0.150191 Oct 03 14:54:53.238336 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 216/402] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:53 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:53.361387 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-ff11dd49-cb87-4648-8995-9fe45557b76b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:53.368890 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-ff11dd49-cb87-4648-8995-9fe45557b76b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1371 microversion: 2.1 time: 0.152841 Oct 03 14:54:53.369452 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 187/403] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:53 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:54:54.261954 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-ab951026-00b4-4815-8978-7cf20a249b78 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:54.262635 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-ab951026-00b4-4815-8978-7cf20a249b78 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:54.269898 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ab951026-00b4-4815-8978-7cf20a249b78 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:54.270384 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ab951026-00b4-4815-8978-7cf20a249b78 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:54.270818 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ab951026-00b4-4815-8978-7cf20a249b78 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:54.271929 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ab951026-00b4-4815-8978-7cf20a249b78 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:54.272384 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ab951026-00b4-4815-8978-7cf20a249b78 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:54.273315 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ab951026-00b4-4815-8978-7cf20a249b78 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:54.393988 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-1e64e31e-2a17-4165-8915-73592c4f4d10 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:54.394759 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-1e64e31e-2a17-4165-8915-73592c4f4d10 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:54.397126 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:54:54.402875 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1e64e31e-2a17-4165-8915-73592c4f4d10 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:54.403365 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1e64e31e-2a17-4165-8915-73592c4f4d10 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:54.404404 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1e64e31e-2a17-4165-8915-73592c4f4d10 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:54.405097 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1e64e31e-2a17-4165-8915-73592c4f4d10 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:54.405568 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1e64e31e-2a17-4165-8915-73592c4f4d10 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:54.405987 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1e64e31e-2a17-4165-8915-73592c4f4d10 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:54.411889 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-ab951026-00b4-4815-8978-7cf20a249b78 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:54.419510 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-ab951026-00b4-4815-8978-7cf20a249b78 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 200 len: 1266 microversion: 2.1 time: 0.161637 Oct 03 14:54:54.420115 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 217/404] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:54 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:54.534459 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-1e64e31e-2a17-4165-8915-73592c4f4d10 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:54.536596 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=100 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:54:54.543347 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-1e64e31e-2a17-4165-8915-73592c4f4d10 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1371 microversion: 2.1 time: 0.153486 Oct 03 14:54:54.543945 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 188/405] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:54 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:54:55.441601 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-e97aac04-5438-4255-bca6-7a1ac18c6d40 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:55.442220 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-e97aac04-5438-4255-bca6-7a1ac18c6d40 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:55.448142 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e97aac04-5438-4255-bca6-7a1ac18c6d40 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:55.448627 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e97aac04-5438-4255-bca6-7a1ac18c6d40 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:55.449063 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e97aac04-5438-4255-bca6-7a1ac18c6d40 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:55.449813 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e97aac04-5438-4255-bca6-7a1ac18c6d40 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:55.450271 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e97aac04-5438-4255-bca6-7a1ac18c6d40 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:55.450697 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e97aac04-5438-4255-bca6-7a1ac18c6d40 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:55.565610 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-20ba88da-7204-460a-ab94-fd5283496794 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:55.566136 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-20ba88da-7204-460a-ab94-fd5283496794 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:55.572841 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-20ba88da-7204-460a-ab94-fd5283496794 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:55.573654 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-20ba88da-7204-460a-ab94-fd5283496794 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:55.574191 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-20ba88da-7204-460a-ab94-fd5283496794 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:55.575013 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-20ba88da-7204-460a-ab94-fd5283496794 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:55.576067 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-20ba88da-7204-460a-ab94-fd5283496794 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:55.576714 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-20ba88da-7204-460a-ab94-fd5283496794 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:55.585194 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-e97aac04-5438-4255-bca6-7a1ac18c6d40 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:55.593768 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-e97aac04-5438-4255-bca6-7a1ac18c6d40 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 200 len: 1266 microversion: 2.1 time: 0.156111 Oct 03 14:54:55.594328 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 218/406] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:55 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:55.711454 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-20ba88da-7204-460a-ab94-fd5283496794 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:55.720233 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-20ba88da-7204-460a-ab94-fd5283496794 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1371 microversion: 2.1 time: 0.158793 Oct 03 14:54:55.721020 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 189/407] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:55 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:54:56.619060 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-8cec01ac-b05c-441e-8c95-f5ea5eb53f13 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:56.620027 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-8cec01ac-b05c-441e-8c95-f5ea5eb53f13 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:56.629279 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8cec01ac-b05c-441e-8c95-f5ea5eb53f13 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:56.630135 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8cec01ac-b05c-441e-8c95-f5ea5eb53f13 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:56.630856 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8cec01ac-b05c-441e-8c95-f5ea5eb53f13 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:56.631963 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8cec01ac-b05c-441e-8c95-f5ea5eb53f13 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:56.632648 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8cec01ac-b05c-441e-8c95-f5ea5eb53f13 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:56.633276 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8cec01ac-b05c-441e-8c95-f5ea5eb53f13 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:56.639549 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=100 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:54:56.744224 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-939d0fa6-cef2-4098-bef7-e7a159890113 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:56.745455 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-939d0fa6-cef2-4098-bef7-e7a159890113 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:56.752695 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-939d0fa6-cef2-4098-bef7-e7a159890113 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:56.753273 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-939d0fa6-cef2-4098-bef7-e7a159890113 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:56.753914 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-939d0fa6-cef2-4098-bef7-e7a159890113 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:56.754690 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-939d0fa6-cef2-4098-bef7-e7a159890113 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:56.755254 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-939d0fa6-cef2-4098-bef7-e7a159890113 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:56.755765 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-939d0fa6-cef2-4098-bef7-e7a159890113 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:56.769426 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-8cec01ac-b05c-441e-8c95-f5ea5eb53f13 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:56.777035 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-8cec01ac-b05c-441e-8c95-f5ea5eb53f13 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 200 len: 1266 microversion: 2.1 time: 0.164295 Oct 03 14:54:56.777627 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 219/408] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:56 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:56.947321 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-939d0fa6-cef2-4098-bef7-e7a159890113 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:56.955240 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-939d0fa6-cef2-4098-bef7-e7a159890113 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1371 microversion: 2.1 time: 0.215739 Oct 03 14:54:56.957167 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 190/409] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:56 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1371 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:57.804074 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-9f890487-cf7f-4622-85ca-895a6b54ecbd tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:57.804695 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-9f890487-cf7f-4622-85ca-895a6b54ecbd tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:57.811285 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9f890487-cf7f-4622-85ca-895a6b54ecbd tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:57.811771 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9f890487-cf7f-4622-85ca-895a6b54ecbd tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:57.812616 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9f890487-cf7f-4622-85ca-895a6b54ecbd tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:57.813307 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9f890487-cf7f-4622-85ca-895a6b54ecbd tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:57.813787 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9f890487-cf7f-4622-85ca-895a6b54ecbd tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:57.814599 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9f890487-cf7f-4622-85ca-895a6b54ecbd tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:57.945862 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-9f890487-cf7f-4622-85ca-895a6b54ecbd tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:57.953636 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-9f890487-cf7f-4622-85ca-895a6b54ecbd tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 200 len: 1266 microversion: 2.1 time: 0.153277 Oct 03 14:54:57.954194 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 220/410] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:57 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:57.978938 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-9ae7ce69-2d36-4a08-a69f-a5b9010855e8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:57.979551 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-9ae7ce69-2d36-4a08-a69f-a5b9010855e8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:57.986350 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9ae7ce69-2d36-4a08-a69f-a5b9010855e8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:57.988402 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9ae7ce69-2d36-4a08-a69f-a5b9010855e8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:57.988402 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9ae7ce69-2d36-4a08-a69f-a5b9010855e8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:57.988402 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9ae7ce69-2d36-4a08-a69f-a5b9010855e8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:57.988690 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9ae7ce69-2d36-4a08-a69f-a5b9010855e8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:57.988917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9ae7ce69-2d36-4a08-a69f-a5b9010855e8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:58.124238 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-9ae7ce69-2d36-4a08-a69f-a5b9010855e8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:58.131919 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-9ae7ce69-2d36-4a08-a69f-a5b9010855e8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1371 microversion: 2.1 time: 0.156698 Oct 03 14:54:58.132488 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 191/411] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:57 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:58.977294 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-062d7b51-7c68-45c1-942c-2468f4624116 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:58.977883 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-062d7b51-7c68-45c1-942c-2468f4624116 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:58.983875 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-062d7b51-7c68-45c1-942c-2468f4624116 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:58.984419 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-062d7b51-7c68-45c1-942c-2468f4624116 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:58.984858 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-062d7b51-7c68-45c1-942c-2468f4624116 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:58.985581 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-062d7b51-7c68-45c1-942c-2468f4624116 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:58.986037 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-062d7b51-7c68-45c1-942c-2468f4624116 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:58.986460 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-062d7b51-7c68-45c1-942c-2468f4624116 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:59.135099 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-062d7b51-7c68-45c1-942c-2468f4624116 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:59.152360 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-062d7b51-7c68-45c1-942c-2468f4624116 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 200 len: 1266 microversion: 2.1 time: 0.169984 Oct 03 14:54:59.152360 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 221/412] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:58 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:59.166280 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-0c5e72d0-cbc7-4be3-a488-5fc657a5638f tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:59.167890 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-0c5e72d0-cbc7-4be3-a488-5fc657a5638f tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:59.173954 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0c5e72d0-cbc7-4be3-a488-5fc657a5638f tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:59.174463 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0c5e72d0-cbc7-4be3-a488-5fc657a5638f tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:59.174864 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0c5e72d0-cbc7-4be3-a488-5fc657a5638f tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:59.175597 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0c5e72d0-cbc7-4be3-a488-5fc657a5638f tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:59.176047 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0c5e72d0-cbc7-4be3-a488-5fc657a5638f tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:59.176460 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0c5e72d0-cbc7-4be3-a488-5fc657a5638f tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:59.309398 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-0c5e72d0-cbc7-4be3-a488-5fc657a5638f tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:59.317561 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-0c5e72d0-cbc7-4be3-a488-5fc657a5638f tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1371 microversion: 2.1 time: 0.155664 Oct 03 14:54:59.327082 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 192/413] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:59 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:55:00.168025 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-5f2ba2a4-c79f-43eb-a986-c6f56f759345 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:00.168632 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-5f2ba2a4-c79f-43eb-a986-c6f56f759345 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:00.174788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5f2ba2a4-c79f-43eb-a986-c6f56f759345 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:00.175272 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5f2ba2a4-c79f-43eb-a986-c6f56f759345 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:00.175701 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5f2ba2a4-c79f-43eb-a986-c6f56f759345 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:00.176386 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5f2ba2a4-c79f-43eb-a986-c6f56f759345 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:00.176836 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5f2ba2a4-c79f-43eb-a986-c6f56f759345 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:00.177558 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5f2ba2a4-c79f-43eb-a986-c6f56f759345 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:00.309152 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-5f2ba2a4-c79f-43eb-a986-c6f56f759345 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:00.316862 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-5f2ba2a4-c79f-43eb-a986-c6f56f759345 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 200 len: 1266 microversion: 2.1 time: 0.152564 Oct 03 14:55:00.317421 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 222/414] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:00 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:00.349425 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-81cf3e6b-87e7-4326-8b2f-d151538813db tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:00.350077 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-81cf3e6b-87e7-4326-8b2f-d151538813db tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:00.356301 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-81cf3e6b-87e7-4326-8b2f-d151538813db tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:00.356785 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-81cf3e6b-87e7-4326-8b2f-d151538813db tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:00.357221 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-81cf3e6b-87e7-4326-8b2f-d151538813db tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:00.357942 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-81cf3e6b-87e7-4326-8b2f-d151538813db tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:00.358399 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-81cf3e6b-87e7-4326-8b2f-d151538813db tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:00.358826 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-81cf3e6b-87e7-4326-8b2f-d151538813db tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:00.482631 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-81cf3e6b-87e7-4326-8b2f-d151538813db tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:00.490083 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-81cf3e6b-87e7-4326-8b2f-d151538813db tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1371 microversion: 2.1 time: 0.144445 Oct 03 14:55:00.490646 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 193/415] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:00 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:01.345121 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-8dc97c49-dbdb-4b99-bf19-7976329668f3 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:01.345693 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-8dc97c49-dbdb-4b99-bf19-7976329668f3 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:01.351550 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8dc97c49-dbdb-4b99-bf19-7976329668f3 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:01.352055 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8dc97c49-dbdb-4b99-bf19-7976329668f3 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:01.352508 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8dc97c49-dbdb-4b99-bf19-7976329668f3 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:01.353183 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8dc97c49-dbdb-4b99-bf19-7976329668f3 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:01.353671 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8dc97c49-dbdb-4b99-bf19-7976329668f3 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:01.354088 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8dc97c49-dbdb-4b99-bf19-7976329668f3 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:01.478432 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-8dc97c49-dbdb-4b99-bf19-7976329668f3 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:01.486376 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-8dc97c49-dbdb-4b99-bf19-7976329668f3 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 200 len: 1266 microversion: 2.1 time: 0.145568 Oct 03 14:55:01.486926 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 223/416] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:01 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:01.512025 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-7e875a11-f21d-470c-8380-badeff019488 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:01.512719 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-7e875a11-f21d-470c-8380-badeff019488 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:01.519190 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7e875a11-f21d-470c-8380-badeff019488 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:01.519674 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7e875a11-f21d-470c-8380-badeff019488 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:01.520104 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7e875a11-f21d-470c-8380-badeff019488 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:01.520794 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7e875a11-f21d-470c-8380-badeff019488 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:01.521251 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7e875a11-f21d-470c-8380-badeff019488 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:01.521730 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7e875a11-f21d-470c-8380-badeff019488 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:01.651722 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-7e875a11-f21d-470c-8380-badeff019488 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:01.659922 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-7e875a11-f21d-470c-8380-badeff019488 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1371 microversion: 2.1 time: 0.151768 Oct 03 14:55:01.660481 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 194/417] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:01 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:01.960584 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-b0c701fc-a2f4-47e1-81d0-6bcac0ed5514 req-3c2ed0fd-d897-4494-8ad9-eacfc3172187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a42b833-728b-44e8-af21-fe86e25c035f", "name": "network-vif-plugged", "status": "completed", "tag": "71f04a2e-59ac-4427-96fb-90ece95bcbde"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:55:01.973259 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-b0c701fc-a2f4-47e1-81d0-6bcac0ed5514 req-3c2ed0fd-d897-4494-8ad9-eacfc3172187 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:01.974481 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-b0c701fc-a2f4-47e1-81d0-6bcac0ed5514 req-3c2ed0fd-d897-4494-8ad9-eacfc3172187 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:01.974919 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-b0c701fc-a2f4-47e1-81d0-6bcac0ed5514 req-3c2ed0fd-d897-4494-8ad9-eacfc3172187 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:01.986631 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-b0c701fc-a2f4-47e1-81d0-6bcac0ed5514 req-3c2ed0fd-d897-4494-8ad9-eacfc3172187 service nova] Creating event network-vif-plugged:71f04a2e-59ac-4427-96fb-90ece95bcbde for instance 3a42b833-728b-44e8-af21-fe86e25c035f on hv-cinder-85987 Oct 03 14:55:01.991724 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-b0c701fc-a2f4-47e1-81d0-6bcac0ed5514 req-3c2ed0fd-d897-4494-8ad9-eacfc3172187 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034843 Oct 03 14:55:01.992435 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 224/418] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:55:02.508088 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-5cd40f74-b992-4823-a3d6-59d71ddbf09b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:02.508806 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-5cd40f74-b992-4823-a3d6-59d71ddbf09b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:02.514910 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5cd40f74-b992-4823-a3d6-59d71ddbf09b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:02.515469 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5cd40f74-b992-4823-a3d6-59d71ddbf09b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:02.515818 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5cd40f74-b992-4823-a3d6-59d71ddbf09b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:02.516706 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5cd40f74-b992-4823-a3d6-59d71ddbf09b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:02.517168 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5cd40f74-b992-4823-a3d6-59d71ddbf09b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:02.517618 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5cd40f74-b992-4823-a3d6-59d71ddbf09b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:02.655177 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-5cd40f74-b992-4823-a3d6-59d71ddbf09b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:02.665178 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-5cd40f74-b992-4823-a3d6-59d71ddbf09b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 200 len: 1266 microversion: 2.1 time: 0.160863 Oct 03 14:55:02.666238 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 195/419] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:02 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:02.685509 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-62f4a902-4dd3-461c-8f4f-d73603306b29 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:02.686336 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-62f4a902-4dd3-461c-8f4f-d73603306b29 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:02.692520 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-62f4a902-4dd3-461c-8f4f-d73603306b29 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:02.693014 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-62f4a902-4dd3-461c-8f4f-d73603306b29 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:02.693454 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-62f4a902-4dd3-461c-8f4f-d73603306b29 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:02.694188 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-62f4a902-4dd3-461c-8f4f-d73603306b29 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:02.694654 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-62f4a902-4dd3-461c-8f4f-d73603306b29 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:02.695084 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-62f4a902-4dd3-461c-8f4f-d73603306b29 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:02.830068 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-62f4a902-4dd3-461c-8f4f-d73603306b29 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:02.837586 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-62f4a902-4dd3-461c-8f4f-d73603306b29 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1371 microversion: 2.1 time: 0.156755 Oct 03 14:55:02.838148 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 225/420] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:02 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:03.689725 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-e605020d-b4d9-42a0-95d1-5a8c0ec765d5 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:03.690356 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-e605020d-b4d9-42a0-95d1-5a8c0ec765d5 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:03.697901 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e605020d-b4d9-42a0-95d1-5a8c0ec765d5 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:03.698408 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e605020d-b4d9-42a0-95d1-5a8c0ec765d5 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:03.698826 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e605020d-b4d9-42a0-95d1-5a8c0ec765d5 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:03.699543 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e605020d-b4d9-42a0-95d1-5a8c0ec765d5 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:03.699997 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e605020d-b4d9-42a0-95d1-5a8c0ec765d5 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:03.701017 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e605020d-b4d9-42a0-95d1-5a8c0ec765d5 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:03.845038 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-e605020d-b4d9-42a0-95d1-5a8c0ec765d5 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:03.854466 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-e605020d-b4d9-42a0-95d1-5a8c0ec765d5 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 200 len: 1266 microversion: 2.1 time: 0.168635 Oct 03 14:55:03.855034 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 196/421] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:03 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:03.864591 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-bee4d189-f1d4-4950-8a67-def2724c6fc0 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:03.864591 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-bee4d189-f1d4-4950-8a67-def2724c6fc0 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:03.873401 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bee4d189-f1d4-4950-8a67-def2724c6fc0 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:03.873401 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bee4d189-f1d4-4950-8a67-def2724c6fc0 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:03.873401 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bee4d189-f1d4-4950-8a67-def2724c6fc0 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:03.873972 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bee4d189-f1d4-4950-8a67-def2724c6fc0 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:03.874567 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bee4d189-f1d4-4950-8a67-def2724c6fc0 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:03.875060 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bee4d189-f1d4-4950-8a67-def2724c6fc0 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:04.058070 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-bee4d189-f1d4-4950-8a67-def2724c6fc0 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:04.068008 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-bee4d189-f1d4-4950-8a67-def2724c6fc0 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1371 microversion: 2.1 time: 0.210316 Oct 03 14:55:04.068770 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 226/422] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:03 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1371 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:55:04.879972 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-c03e0824-986a-42d9-b28f-3d9d1c401ffd tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:04.880579 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-c03e0824-986a-42d9-b28f-3d9d1c401ffd tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:04.886802 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c03e0824-986a-42d9-b28f-3d9d1c401ffd tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:04.887278 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c03e0824-986a-42d9-b28f-3d9d1c401ffd tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:04.888195 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c03e0824-986a-42d9-b28f-3d9d1c401ffd tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:04.888882 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c03e0824-986a-42d9-b28f-3d9d1c401ffd tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:04.889334 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c03e0824-986a-42d9-b28f-3d9d1c401ffd tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:04.889799 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c03e0824-986a-42d9-b28f-3d9d1c401ffd tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:05.021864 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-c03e0824-986a-42d9-b28f-3d9d1c401ffd tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:05.029621 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-c03e0824-986a-42d9-b28f-3d9d1c401ffd tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 200 len: 1266 microversion: 2.1 time: 0.153420 Oct 03 14:55:05.030208 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 197/423] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:04 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:05.091256 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-483aebe9-bafe-440f-9bae-418dfafc69fd tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:05.091864 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-483aebe9-bafe-440f-9bae-418dfafc69fd tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:05.097730 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-483aebe9-bafe-440f-9bae-418dfafc69fd tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:05.098239 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-483aebe9-bafe-440f-9bae-418dfafc69fd tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:05.098672 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-483aebe9-bafe-440f-9bae-418dfafc69fd tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:05.099369 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-483aebe9-bafe-440f-9bae-418dfafc69fd tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:05.099823 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-483aebe9-bafe-440f-9bae-418dfafc69fd tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:05.100253 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-483aebe9-bafe-440f-9bae-418dfafc69fd tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:05.243607 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-483aebe9-bafe-440f-9bae-418dfafc69fd tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:05.252966 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-483aebe9-bafe-440f-9bae-418dfafc69fd tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1371 microversion: 2.1 time: 0.165723 Oct 03 14:55:05.253570 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 227/424] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:05 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:06.052226 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-8228ed59-82a8-4074-860a-bce063581d33 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:06.052787 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-8228ed59-82a8-4074-860a-bce063581d33 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:06.059286 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8228ed59-82a8-4074-860a-bce063581d33 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:06.059761 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8228ed59-82a8-4074-860a-bce063581d33 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:06.060189 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8228ed59-82a8-4074-860a-bce063581d33 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:06.060870 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8228ed59-82a8-4074-860a-bce063581d33 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:06.061326 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8228ed59-82a8-4074-860a-bce063581d33 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:06.061766 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8228ed59-82a8-4074-860a-bce063581d33 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:06.193864 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-8228ed59-82a8-4074-860a-bce063581d33 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:06.204238 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-8228ed59-82a8-4074-860a-bce063581d33 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 200 len: 1266 microversion: 2.1 time: 0.154624 Oct 03 14:55:06.205599 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 198/425] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:06 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:06.286875 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-5bf14b38-d4cd-4e09-95a8-3ba9ca20ad4b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:06.288026 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-5bf14b38-d4cd-4e09-95a8-3ba9ca20ad4b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:06.303735 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5bf14b38-d4cd-4e09-95a8-3ba9ca20ad4b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:06.304156 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5bf14b38-d4cd-4e09-95a8-3ba9ca20ad4b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:06.305242 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5bf14b38-d4cd-4e09-95a8-3ba9ca20ad4b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:06.306051 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5bf14b38-d4cd-4e09-95a8-3ba9ca20ad4b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:06.306845 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5bf14b38-d4cd-4e09-95a8-3ba9ca20ad4b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:06.307427 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5bf14b38-d4cd-4e09-95a8-3ba9ca20ad4b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:06.420763 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-610de1ac-0f59-428f-a26e-2b759e4a192b req-3410eef8-3cca-4810-8f4c-609976073175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8565107e-de79-4c29-a92d-0dcc47cdaad4", "name": "network-vif-plugged", "status": "completed", "tag": "844f2524-468f-4861-a833-34bb9a1e4138"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:55:06.432780 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-610de1ac-0f59-428f-a26e-2b759e4a192b req-3410eef8-3cca-4810-8f4c-609976073175 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:06.433336 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-610de1ac-0f59-428f-a26e-2b759e4a192b req-3410eef8-3cca-4810-8f4c-609976073175 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:06.433867 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-610de1ac-0f59-428f-a26e-2b759e4a192b req-3410eef8-3cca-4810-8f4c-609976073175 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:06.451298 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-610de1ac-0f59-428f-a26e-2b759e4a192b req-3410eef8-3cca-4810-8f4c-609976073175 service nova] Creating event network-vif-plugged:844f2524-468f-4861-a833-34bb9a1e4138 for instance 8565107e-de79-4c29-a92d-0dcc47cdaad4 on hv-cinder-85987 Oct 03 14:55:06.457734 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-610de1ac-0f59-428f-a26e-2b759e4a192b req-3410eef8-3cca-4810-8f4c-609976073175 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040538 Oct 03 14:55:06.458911 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 199/426] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:55:06.461849 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-5bf14b38-d4cd-4e09-95a8-3ba9ca20ad4b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:06.470259 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-5bf14b38-d4cd-4e09-95a8-3ba9ca20ad4b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1565 microversion: 2.1 time: 0.197048 Oct 03 14:55:06.470822 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 228/427] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:06 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1565 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:06.492842 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-9a6e2bf9-04d7-486e-bf81-0339738c5e2c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:06.493477 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-9a6e2bf9-04d7-486e-bf81-0339738c5e2c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:06.500303 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9a6e2bf9-04d7-486e-bf81-0339738c5e2c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:06.500899 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9a6e2bf9-04d7-486e-bf81-0339738c5e2c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:06.501206 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9a6e2bf9-04d7-486e-bf81-0339738c5e2c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:06.501973 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9a6e2bf9-04d7-486e-bf81-0339738c5e2c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:06.502432 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9a6e2bf9-04d7-486e-bf81-0339738c5e2c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:06.502849 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9a6e2bf9-04d7-486e-bf81-0339738c5e2c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:06.580617 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-9a6e2bf9-04d7-486e-bf81-0339738c5e2c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092015 Oct 03 14:55:06.581226 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 200/428] 10.222.0.46 () {58 vars in 1275 bytes} [Mon Oct 3 14:55:06 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:55:07.229396 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-9b156453-b2c6-41ef-a1ed-6095dd5522eb tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:07.232143 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-9b156453-b2c6-41ef-a1ed-6095dd5522eb tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:07.238140 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9b156453-b2c6-41ef-a1ed-6095dd5522eb tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:07.238630 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9b156453-b2c6-41ef-a1ed-6095dd5522eb tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:07.239069 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9b156453-b2c6-41ef-a1ed-6095dd5522eb tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:07.239762 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9b156453-b2c6-41ef-a1ed-6095dd5522eb tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:07.240228 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9b156453-b2c6-41ef-a1ed-6095dd5522eb tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:07.240659 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9b156453-b2c6-41ef-a1ed-6095dd5522eb tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:07.415448 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-9b156453-b2c6-41ef-a1ed-6095dd5522eb tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:07.424949 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-9b156453-b2c6-41ef-a1ed-6095dd5522eb tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 200 len: 1266 microversion: 2.1 time: 0.199430 Oct 03 14:55:07.425613 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 229/429] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:07 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:07.592169 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-ddd142d6-420e-44ed-866d-b826d2eb6701 req-82a0fa17-e863-4d16-86c4-c320c59b1ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a42b833-728b-44e8-af21-fe86e25c035f", "tag": "71f04a2e-59ac-4427-96fb-90ece95bcbde"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:55:07.601606 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-ddd142d6-420e-44ed-866d-b826d2eb6701 req-82a0fa17-e863-4d16-86c4-c320c59b1ec5 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:07.602089 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-ddd142d6-420e-44ed-866d-b826d2eb6701 req-82a0fa17-e863-4d16-86c4-c320c59b1ec5 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:07.602514 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-ddd142d6-420e-44ed-866d-b826d2eb6701 req-82a0fa17-e863-4d16-86c4-c320c59b1ec5 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:07.615709 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-ddd142d6-420e-44ed-866d-b826d2eb6701 req-82a0fa17-e863-4d16-86c4-c320c59b1ec5 service nova] Creating event network-changed:71f04a2e-59ac-4427-96fb-90ece95bcbde for instance 3a42b833-728b-44e8-af21-fe86e25c035f on hv-cinder-85987 Oct 03 14:55:07.620948 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-ddd142d6-420e-44ed-866d-b826d2eb6701 req-82a0fa17-e863-4d16-86c4-c320c59b1ec5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033670 Oct 03 14:55:07.622120 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 201/430] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:55:08.448237 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-2be070fb-a2b0-408e-b868-d5a7210330e6 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:08.450578 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-2be070fb-a2b0-408e-b868-d5a7210330e6 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:08.461658 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2be070fb-a2b0-408e-b868-d5a7210330e6 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:08.470263 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2be070fb-a2b0-408e-b868-d5a7210330e6 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:08.470716 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2be070fb-a2b0-408e-b868-d5a7210330e6 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:08.471458 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2be070fb-a2b0-408e-b868-d5a7210330e6 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:08.471915 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2be070fb-a2b0-408e-b868-d5a7210330e6 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:08.472337 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2be070fb-a2b0-408e-b868-d5a7210330e6 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:08.700736 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-2be070fb-a2b0-408e-b868-d5a7210330e6 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:08.710145 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-2be070fb-a2b0-408e-b868-d5a7210330e6 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 200 len: 1266 microversion: 2.1 time: 0.265556 Oct 03 14:55:08.716905 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 230/431] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:08 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 1266 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:09.736885 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-d8316e2b-3070-4a30-9a8a-6e9960951ca2 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:09.737966 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-d8316e2b-3070-4a30-9a8a-6e9960951ca2 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:09.745427 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d8316e2b-3070-4a30-9a8a-6e9960951ca2 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:09.746271 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d8316e2b-3070-4a30-9a8a-6e9960951ca2 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:09.747533 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d8316e2b-3070-4a30-9a8a-6e9960951ca2 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:09.748634 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d8316e2b-3070-4a30-9a8a-6e9960951ca2 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:09.749339 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d8316e2b-3070-4a30-9a8a-6e9960951ca2 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:09.749902 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d8316e2b-3070-4a30-9a8a-6e9960951ca2 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:09.975753 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-d8316e2b-3070-4a30-9a8a-6e9960951ca2 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:09.987312 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-d8316e2b-3070-4a30-9a8a-6e9960951ca2 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 200 len: 1453 microversion: 2.1 time: 0.254737 Oct 03 14:55:09.988376 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 202/432] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:09 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 1453 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:10.010522 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-8e89cefa-dd18-44bb-b96f-6ff2a44833ae tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:10.011133 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-8e89cefa-dd18-44bb-b96f-6ff2a44833ae tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:10.017358 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8e89cefa-dd18-44bb-b96f-6ff2a44833ae tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:10.017874 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8e89cefa-dd18-44bb-b96f-6ff2a44833ae tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:10.018363 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8e89cefa-dd18-44bb-b96f-6ff2a44833ae tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:10.019074 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8e89cefa-dd18-44bb-b96f-6ff2a44833ae tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:10.019520 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8e89cefa-dd18-44bb-b96f-6ff2a44833ae tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:10.020006 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8e89cefa-dd18-44bb-b96f-6ff2a44833ae tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:10.227480 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-8e89cefa-dd18-44bb-b96f-6ff2a44833ae tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:10.237119 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-8e89cefa-dd18-44bb-b96f-6ff2a44833ae tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 200 len: 1453 microversion: 2.1 time: 0.230127 Oct 03 14:55:10.238541 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 231/433] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:10 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 1453 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:12.529174 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-a8e99ee8-5e70-4c94-8191-5ddf9577ff88 req-db8fdc31-db97-488b-8468-721e16c781c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8565107e-de79-4c29-a92d-0dcc47cdaad4", "tag": "844f2524-468f-4861-a833-34bb9a1e4138"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:55:12.539947 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-a8e99ee8-5e70-4c94-8191-5ddf9577ff88 req-db8fdc31-db97-488b-8468-721e16c781c4 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:12.540440 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-a8e99ee8-5e70-4c94-8191-5ddf9577ff88 req-db8fdc31-db97-488b-8468-721e16c781c4 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:12.540878 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-a8e99ee8-5e70-4c94-8191-5ddf9577ff88 req-db8fdc31-db97-488b-8468-721e16c781c4 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:12.554278 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-a8e99ee8-5e70-4c94-8191-5ddf9577ff88 req-db8fdc31-db97-488b-8468-721e16c781c4 service nova] Creating event network-changed:844f2524-468f-4861-a833-34bb9a1e4138 for instance 8565107e-de79-4c29-a92d-0dcc47cdaad4 on hv-cinder-85987 Oct 03 14:55:12.561646 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-a8e99ee8-5e70-4c94-8191-5ddf9577ff88 req-db8fdc31-db97-488b-8468-721e16c781c4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036052 Oct 03 14:55:12.566449 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 203/434] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:55:20.017201 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_api:SELECT=49 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:55:20.145178 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-a73db7ae-4e0d-4af3-a8e3-2c9a4d08cf56 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Action: 'create', calling method: .version_select at 0x7fe0d37fc430>, body: {"keypair": {"name": "tempest-TestShelveInstance-300642761", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/RUnapF8m0VY0NEm87kyZzX2IBAW3dooVUzCyk1+arfjDJ5qa/lpbWmHaMKFcicYS10Uu9E73TWO/tlAiVQCE7pNG4tzR7NUVt6sG9T6627i7MvdMY3jGFAoRcfNXD9A=="}} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:55:20.161889 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.quota [None req-a73db7ae-4e0d-4af3-a8e3-2c9a4d08cf56 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Getting quotas for project 8fae62571c3c402a8fcc4afaf4268310. Resources: {'key_pairs'} {{(pid=126851) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:55:20.166253 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.quota [None req-a73db7ae-4e0d-4af3-a8e3-2c9a4d08cf56 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Getting quotas for user 7725c72e89964487843bc9bd46b8e3d2 and project 8fae62571c3c402a8fcc4afaf4268310. Resources: {'key_pairs'} {{(pid=126851) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:55:20.191789 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-a73db7ae-4e0d-4af3-a8e3-2c9a4d08cf56 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.260282 Oct 03 14:55:20.201842 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 232/435] 10.222.0.46 () {60 vars in 1159 bytes} [Mon Oct 3 14:55:19 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:55:29.048053 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-4551c44b-bc3b-4d1b-ac6c-21b4493d7b26 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:29.048724 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-4551c44b-bc3b-4d1b-ac6c-21b4493d7b26 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:29.051475 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_api:SELECT=31 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:55:29.052128 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=77 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:55:29.059212 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4551c44b-bc3b-4d1b-ac6c-21b4493d7b26 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:29.059728 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4551c44b-bc3b-4d1b-ac6c-21b4493d7b26 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:29.060163 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4551c44b-bc3b-4d1b-ac6c-21b4493d7b26 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:29.060857 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4551c44b-bc3b-4d1b-ac6c-21b4493d7b26 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:29.061314 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4551c44b-bc3b-4d1b-ac6c-21b4493d7b26 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:29.061773 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4551c44b-bc3b-4d1b-ac6c-21b4493d7b26 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:29.085048 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-4551c44b-bc3b-4d1b-ac6c-21b4493d7b26 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8/ips" status: 200 len: 148 microversion: 2.1 time: 0.041246 Oct 03 14:55:29.085734 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 204/436] 10.222.0.46 () {58 vars in 1248 bytes} [Mon Oct 3 14:55:29 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8/ips => generated 148 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:55:30.240231 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=73 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:55:30.241547 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 14:55:30.241779 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Mon Oct 3 14:55:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db/ips (ip 10.222.0.46) !!! Oct 03 14:55:30.243826 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell0:SELECT=4 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:55:30.244576 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:55:30.249529 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-7ed145e7-ed95-4617-b7ad-bdaa135ac541 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:30.250030 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-7ed145e7-ed95-4617-b7ad-bdaa135ac541 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:30.259271 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7ed145e7-ed95-4617-b7ad-bdaa135ac541 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:30.259757 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7ed145e7-ed95-4617-b7ad-bdaa135ac541 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:30.260201 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7ed145e7-ed95-4617-b7ad-bdaa135ac541 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:30.260887 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7ed145e7-ed95-4617-b7ad-bdaa135ac541 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:30.261868 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7ed145e7-ed95-4617-b7ad-bdaa135ac541 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:30.262294 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7ed145e7-ed95-4617-b7ad-bdaa135ac541 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:30.290818 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-7ed145e7-ed95-4617-b7ad-bdaa135ac541 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db/ips" status: 200 len: 152 microversion: 2.20 time: 0.051168 Oct 03 14:55:30.291395 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 233/437] 10.222.0.46 () {60 vars in 1289 bytes} [Mon Oct 3 14:55:30 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db/ips => generated 152 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:55:31.527823 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-e2b83903-28e3-4276-abd7-61e8f8a62336 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35cd8659-2a87-46de-b13f-4e95d02ec7f5"}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:55:31.530905 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-e2b83903-28e3-4276-abd7-61e8f8a62336 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:31.537830 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e2b83903-28e3-4276-abd7-61e8f8a62336 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:31.538321 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e2b83903-28e3-4276-abd7-61e8f8a62336 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:31.538755 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e2b83903-28e3-4276-abd7-61e8f8a62336 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:31.539460 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e2b83903-28e3-4276-abd7-61e8f8a62336 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:31.539917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e2b83903-28e3-4276-abd7-61e8f8a62336 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:31.540340 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e2b83903-28e3-4276-abd7-61e8f8a62336 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:31.821158 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-e2b83903-28e3-4276-abd7-61e8f8a62336 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "POST /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297057 Oct 03 14:55:31.821815 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 205/438] 10.222.0.46 () {60 vars in 1323 bytes} [Mon Oct 3 14:55:31 2022] POST /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:55:33.358977 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-291ace28-4d2b-4330-ab3f-30d74ecac61e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:55:33.360015 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-291ace28-4d2b-4330-ab3f-30d74ecac61e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:33.367504 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-291ace28-4d2b-4330-ab3f-30d74ecac61e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:33.368655 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-291ace28-4d2b-4330-ab3f-30d74ecac61e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:33.369471 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-291ace28-4d2b-4330-ab3f-30d74ecac61e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:33.370431 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-291ace28-4d2b-4330-ab3f-30d74ecac61e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:33.371070 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-291ace28-4d2b-4330-ab3f-30d74ecac61e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:33.371517 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-291ace28-4d2b-4330-ab3f-30d74ecac61e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:33.394671 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.objects.instance [None req-291ace28-4d2b-4330-ab3f-30d74ecac61e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lazy-loading 'flavor' on Instance uuid 27879d6c-62f5-4281-b134-faecf706a2db {{(pid=126851) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:55:39.377831 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-492df196-81ff-401e-8c71-001e091ed5bd tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Action: 'create', calling method: .version_select at 0x7fe0d3581a60>, body: {"keypair": {"name": "tempest-keypair-812412667", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPl1AZHY7jyMLfHWQH0PNKsHAfx+J0bkizExbljQ1adD5E55LdbhOlSNrdv5obihafQMqmMtJ12HMgK8sARK/u0IHqpisF3KW0/uGEXB/ev7raC3LeFB3vxLSw76dWvNDg=="}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:55:39.392808 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-492df196-81ff-401e-8c71-001e091ed5bd tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Getting quotas for project f441c0592cd146d3be851ac96cbc49dc. Resources: {'key_pairs'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:55:39.396614 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-492df196-81ff-401e-8c71-001e091ed5bd tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Getting quotas for user 89c747f18b434e469ae61755e9f639ca and project f441c0592cd146d3be851ac96cbc49dc. Resources: {'key_pairs'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:55:39.419396 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-492df196-81ff-401e-8c71-001e091ed5bd tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045649 Oct 03 14:55:39.419970 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 206/439] 10.222.0.46 () {60 vars in 1159 bytes} [Mon Oct 3 14:55:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:55:40.708660 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-8345fb88-c98a-4fbb-aae6-3b3b9e6c601a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1295984301", "imageRef": "add7a872-2ca1-4366-9a93-f0663fdb297b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3b88fdf3-b260-41ad-9765-7cbb7b33b8ed"}], "security_groups": [{"name": "tempest-securitygroup--1908753844"}], "key_name": "tempest-keypair-812412667", "user_data": "}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:55:41.634046 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-291ace28-4d2b-4330-ab3f-30d74ecac61e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "POST /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db/action" status: 202 len: 0 microversion: 2.20 time: 8.279612 Oct 03 14:55:41.634694 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 234/440] 10.222.0.46 () {62 vars in 1319 bytes} [Mon Oct 3 14:55:33 2022] POST /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db/action => generated 0 bytes in 8281 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 03 14:55:41.643906 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-3709fbda-b33e-4dfd-b0ec-2553aff374d5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:41.644925 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-3709fbda-b33e-4dfd-b0ec-2553aff374d5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:41.652314 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3709fbda-b33e-4dfd-b0ec-2553aff374d5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:41.653736 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3709fbda-b33e-4dfd-b0ec-2553aff374d5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:41.654264 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3709fbda-b33e-4dfd-b0ec-2553aff374d5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:41.655099 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3709fbda-b33e-4dfd-b0ec-2553aff374d5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:41.655637 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3709fbda-b33e-4dfd-b0ec-2553aff374d5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:41.656151 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3709fbda-b33e-4dfd-b0ec-2553aff374d5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:41.694327 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.network.neutron [None req-8345fb88-c98a-4fbb-aae6-3b3b9e6c601a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] validate_networks() for [('3b88fdf3-b260-41ad-9765-7cbb7b33b8ed', None, None, None, None, None)] {{(pid=126852) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:55:41.796924 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-3709fbda-b33e-4dfd-b0ec-2553aff374d5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:41.806489 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-3709fbda-b33e-4dfd-b0ec-2553aff374d5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:41.808164 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-3709fbda-b33e-4dfd-b0ec-2553aff374d5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:41.810348 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-3709fbda-b33e-4dfd-b0ec-2553aff374d5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1724 microversion: 2.20 time: 0.170528 Oct 03 14:55:41.811195 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 235/441] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:55:41 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:55:41.822506 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:55:42.098607 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-8345fb88-c98a-4fbb-aae6-3b3b9e6c601a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Flavor limits 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:55:42.098992 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-8345fb88-c98a-4fbb-aae6-3b3b9e6c601a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Image limits 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:55:42.099466 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-8345fb88-c98a-4fbb-aae6-3b3b9e6c601a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Flavor pref 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:55:42.099960 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-8345fb88-c98a-4fbb-aae6-3b3b9e6c601a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Image pref 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:55:42.100367 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-8345fb88-c98a-4fbb-aae6-3b3b9e6c601a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:55:42.109484 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8345fb88-c98a-4fbb-aae6-3b3b9e6c601a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:42.109991 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8345fb88-c98a-4fbb-aae6-3b3b9e6c601a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:42.110418 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8345fb88-c98a-4fbb-aae6-3b3b9e6c601a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:42.111163 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8345fb88-c98a-4fbb-aae6-3b3b9e6c601a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:42.111642 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8345fb88-c98a-4fbb-aae6-3b3b9e6c601a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:42.112040 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8345fb88-c98a-4fbb-aae6-3b3b9e6c601a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:42.129955 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-8345fb88-c98a-4fbb-aae6-3b3b9e6c601a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Getting quotas for project f441c0592cd146d3be851ac96cbc49dc. Resources: {'ram', 'instances', 'cores'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:55:42.133800 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-8345fb88-c98a-4fbb-aae6-3b3b9e6c601a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Getting quotas for user 89c747f18b434e469ae61755e9f639ca and project f441c0592cd146d3be851ac96cbc49dc. Resources: {'ram', 'instances', 'cores'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:55:42.144646 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-8345fb88-c98a-4fbb-aae6-3b3b9e6c601a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Going to run 1 instances... {{(pid=126852) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:55:42.147032 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-8345fb88-c98a-4fbb-aae6-3b3b9e6c601a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: f8993421-0b03-4554-aa82-b608a3baebe2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='add7a872-2ca1-4366-9a93-f0663fdb297b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:55:42.193657 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-8345fb88-c98a-4fbb-aae6-3b3b9e6c601a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.489739 Oct 03 14:55:42.194343 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 207/442] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 3 14:55:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 1491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 14:55:42.205757 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-0328051c-196d-47da-93c0-a768dac025ad tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:42.206379 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-0328051c-196d-47da-93c0-a768dac025ad tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: f8993421-0b03-4554-aa82-b608a3baebe2] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:42.260501 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-0328051c-196d-47da-93c0-a768dac025ad tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:42.268792 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-0328051c-196d-47da-93c0-a768dac025ad tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2" status: 200 len: 1241 microversion: 2.1 time: 0.067000 Oct 03 14:55:42.269350 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 236/443] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:42 2022] GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:42.846600 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-595cbbd9-464a-4fd3-88ec-adecd5f48367 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:42.847347 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-595cbbd9-464a-4fd3-88ec-adecd5f48367 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:42.854050 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-595cbbd9-464a-4fd3-88ec-adecd5f48367 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:42.854539 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-595cbbd9-464a-4fd3-88ec-adecd5f48367 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:42.854984 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-595cbbd9-464a-4fd3-88ec-adecd5f48367 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:42.855685 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-595cbbd9-464a-4fd3-88ec-adecd5f48367 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:42.856633 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-595cbbd9-464a-4fd3-88ec-adecd5f48367 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:42.857065 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-595cbbd9-464a-4fd3-88ec-adecd5f48367 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:42.998552 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-595cbbd9-464a-4fd3-88ec-adecd5f48367 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:43.007011 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-595cbbd9-464a-4fd3-88ec-adecd5f48367 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:43.008514 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-595cbbd9-464a-4fd3-88ec-adecd5f48367 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:43.009777 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-595cbbd9-464a-4fd3-88ec-adecd5f48367 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1724 microversion: 2.20 time: 0.167443 Oct 03 14:55:43.010362 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 208/444] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:55:42 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:55:43.290560 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-becb5266-3280-4a70-876c-4070d62d1496 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:43.291220 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-becb5266-3280-4a70-876c-4070d62d1496 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: f8993421-0b03-4554-aa82-b608a3baebe2] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:43.298503 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-becb5266-3280-4a70-876c-4070d62d1496 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:43.298607 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-becb5266-3280-4a70-876c-4070d62d1496 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:43.299870 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-becb5266-3280-4a70-876c-4070d62d1496 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:43.300521 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-becb5266-3280-4a70-876c-4070d62d1496 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:43.300979 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-becb5266-3280-4a70-876c-4070d62d1496 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:43.301403 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-becb5266-3280-4a70-876c-4070d62d1496 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:43.363395 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-becb5266-3280-4a70-876c-4070d62d1496 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:43.371232 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-becb5266-3280-4a70-876c-4070d62d1496 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2" status: 200 len: 1293 microversion: 2.1 time: 0.084658 Oct 03 14:55:43.371794 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 237/445] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:43 2022] GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:44.035960 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-99c235aa-f373-49d5-9f6e-913255a998f3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:44.036573 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-99c235aa-f373-49d5-9f6e-913255a998f3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:44.042941 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-99c235aa-f373-49d5-9f6e-913255a998f3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:44.043424 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-99c235aa-f373-49d5-9f6e-913255a998f3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:44.043867 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-99c235aa-f373-49d5-9f6e-913255a998f3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:44.045223 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-99c235aa-f373-49d5-9f6e-913255a998f3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:44.045718 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-99c235aa-f373-49d5-9f6e-913255a998f3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:44.046150 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-99c235aa-f373-49d5-9f6e-913255a998f3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:44.193478 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-99c235aa-f373-49d5-9f6e-913255a998f3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:44.201374 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-99c235aa-f373-49d5-9f6e-913255a998f3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:44.202938 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-99c235aa-f373-49d5-9f6e-913255a998f3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:44.204094 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-99c235aa-f373-49d5-9f6e-913255a998f3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1724 microversion: 2.20 time: 0.172103 Oct 03 14:55:44.204648 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 209/446] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:55:44 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:55:44.394687 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-15c3048b-5ebb-4d37-b2bf-5020b784869e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:44.395215 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-15c3048b-5ebb-4d37-b2bf-5020b784869e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: f8993421-0b03-4554-aa82-b608a3baebe2] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:44.401467 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-15c3048b-5ebb-4d37-b2bf-5020b784869e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:44.401975 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-15c3048b-5ebb-4d37-b2bf-5020b784869e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:44.402405 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-15c3048b-5ebb-4d37-b2bf-5020b784869e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:44.403092 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-15c3048b-5ebb-4d37-b2bf-5020b784869e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:44.403542 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-15c3048b-5ebb-4d37-b2bf-5020b784869e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:44.404579 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-15c3048b-5ebb-4d37-b2bf-5020b784869e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:44.468964 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-15c3048b-5ebb-4d37-b2bf-5020b784869e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:44.482208 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-15c3048b-5ebb-4d37-b2bf-5020b784869e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2" status: 200 len: 1299 microversion: 2.1 time: 0.091429 Oct 03 14:55:44.482792 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 238/447] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:44 2022] GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2 => generated 1299 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:45.230267 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-8e4b57f7-38b7-4ffa-a115-a346c5fc2f74 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:45.230875 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-8e4b57f7-38b7-4ffa-a115-a346c5fc2f74 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:45.238615 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8e4b57f7-38b7-4ffa-a115-a346c5fc2f74 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:45.239105 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8e4b57f7-38b7-4ffa-a115-a346c5fc2f74 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:45.239542 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8e4b57f7-38b7-4ffa-a115-a346c5fc2f74 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:45.240423 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8e4b57f7-38b7-4ffa-a115-a346c5fc2f74 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:45.240879 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8e4b57f7-38b7-4ffa-a115-a346c5fc2f74 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:45.241304 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8e4b57f7-38b7-4ffa-a115-a346c5fc2f74 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:45.450981 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-8e4b57f7-38b7-4ffa-a115-a346c5fc2f74 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:45.462745 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-8e4b57f7-38b7-4ffa-a115-a346c5fc2f74 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:45.464590 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-8e4b57f7-38b7-4ffa-a115-a346c5fc2f74 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:45.465943 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-8e4b57f7-38b7-4ffa-a115-a346c5fc2f74 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1724 microversion: 2.20 time: 0.239526 Oct 03 14:55:45.467303 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 210/448] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:55:45 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:55:45.485677 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-5501c923-e377-4b9e-87da-2a29a8c6620a req-c47e3b79-a19a-472f-8c76-e74594ea2eed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8993421-0b03-4554-aa82-b608a3baebe2", "tag": "e2d275ba-9f0b-4940-b899-d1d6d34a79b3"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:55:45.496148 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-5501c923-e377-4b9e-87da-2a29a8c6620a req-c47e3b79-a19a-472f-8c76-e74594ea2eed service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:45.496635 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-5501c923-e377-4b9e-87da-2a29a8c6620a req-c47e3b79-a19a-472f-8c76-e74594ea2eed service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:45.497063 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-5501c923-e377-4b9e-87da-2a29a8c6620a req-c47e3b79-a19a-472f-8c76-e74594ea2eed service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:45.506362 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-a39aa3ff-d4e9-4b97-84ef-739c7884db8c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:45.507133 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-a39aa3ff-d4e9-4b97-84ef-739c7884db8c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: f8993421-0b03-4554-aa82-b608a3baebe2] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:45.510797 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-5501c923-e377-4b9e-87da-2a29a8c6620a req-c47e3b79-a19a-472f-8c76-e74594ea2eed service nova] Creating event network-changed:e2d275ba-9f0b-4940-b899-d1d6d34a79b3 for instance f8993421-0b03-4554-aa82-b608a3baebe2 on hv-cinder-85987 Oct 03 14:55:45.513987 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a39aa3ff-d4e9-4b97-84ef-739c7884db8c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:45.514557 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a39aa3ff-d4e9-4b97-84ef-739c7884db8c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:45.515060 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a39aa3ff-d4e9-4b97-84ef-739c7884db8c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:45.516058 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a39aa3ff-d4e9-4b97-84ef-739c7884db8c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:45.516300 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-5501c923-e377-4b9e-87da-2a29a8c6620a req-c47e3b79-a19a-472f-8c76-e74594ea2eed service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035054 Oct 03 14:55:45.516663 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a39aa3ff-d4e9-4b97-84ef-739c7884db8c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:45.516899 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 239/449] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:55:45.517235 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a39aa3ff-d4e9-4b97-84ef-739c7884db8c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:45.765878 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-a39aa3ff-d4e9-4b97-84ef-739c7884db8c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:45.774016 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-a39aa3ff-d4e9-4b97-84ef-739c7884db8c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2" status: 200 len: 1367 microversion: 2.1 time: 0.271718 Oct 03 14:55:45.774584 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 211/450] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:45 2022] GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2 => generated 1367 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:46.492570 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-91ce8bbf-8f2a-46ce-afdd-3f11af6f6916 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:46.493260 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-91ce8bbf-8f2a-46ce-afdd-3f11af6f6916 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:46.500074 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-91ce8bbf-8f2a-46ce-afdd-3f11af6f6916 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:46.500562 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-91ce8bbf-8f2a-46ce-afdd-3f11af6f6916 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:46.500992 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-91ce8bbf-8f2a-46ce-afdd-3f11af6f6916 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:46.501710 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-91ce8bbf-8f2a-46ce-afdd-3f11af6f6916 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:46.502160 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-91ce8bbf-8f2a-46ce-afdd-3f11af6f6916 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:46.502611 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-91ce8bbf-8f2a-46ce-afdd-3f11af6f6916 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:46.630224 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-91ce8bbf-8f2a-46ce-afdd-3f11af6f6916 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:46.638799 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-91ce8bbf-8f2a-46ce-afdd-3f11af6f6916 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:46.640225 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-91ce8bbf-8f2a-46ce-afdd-3f11af6f6916 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:46.641360 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-91ce8bbf-8f2a-46ce-afdd-3f11af6f6916 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1724 microversion: 2.20 time: 0.153045 Oct 03 14:55:46.641944 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 240/451] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:55:46 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:55:46.797476 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-c36bb823-37ba-46c3-a4d8-00be0c1a686f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:46.798122 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-c36bb823-37ba-46c3-a4d8-00be0c1a686f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: f8993421-0b03-4554-aa82-b608a3baebe2] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:46.804469 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c36bb823-37ba-46c3-a4d8-00be0c1a686f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:46.804954 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c36bb823-37ba-46c3-a4d8-00be0c1a686f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:46.805390 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c36bb823-37ba-46c3-a4d8-00be0c1a686f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:46.806117 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c36bb823-37ba-46c3-a4d8-00be0c1a686f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:46.806576 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c36bb823-37ba-46c3-a4d8-00be0c1a686f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:46.807003 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c36bb823-37ba-46c3-a4d8-00be0c1a686f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:46.935083 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-c36bb823-37ba-46c3-a4d8-00be0c1a686f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:46.942646 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-c36bb823-37ba-46c3-a4d8-00be0c1a686f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2" status: 200 len: 1367 microversion: 2.1 time: 0.149510 Oct 03 14:55:46.943215 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 212/452] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:46 2022] GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:47.665472 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-a8877f8a-64fe-4bb3-9727-39d91f43707d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:47.666126 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-a8877f8a-64fe-4bb3-9727-39d91f43707d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:47.672895 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a8877f8a-64fe-4bb3-9727-39d91f43707d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:47.673260 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a8877f8a-64fe-4bb3-9727-39d91f43707d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:47.673745 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a8877f8a-64fe-4bb3-9727-39d91f43707d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:47.674471 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a8877f8a-64fe-4bb3-9727-39d91f43707d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:47.674927 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a8877f8a-64fe-4bb3-9727-39d91f43707d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:47.675350 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a8877f8a-64fe-4bb3-9727-39d91f43707d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:47.801663 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-a8877f8a-64fe-4bb3-9727-39d91f43707d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:47.809549 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-a8877f8a-64fe-4bb3-9727-39d91f43707d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:47.810982 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-a8877f8a-64fe-4bb3-9727-39d91f43707d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:47.812240 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-a8877f8a-64fe-4bb3-9727-39d91f43707d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1724 microversion: 2.20 time: 0.150492 Oct 03 14:55:47.812795 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 241/453] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:55:47 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:55:47.964378 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-ea030d36-a11f-406f-9a8e-0f32b472b8f5 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:47.965017 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-ea030d36-a11f-406f-9a8e-0f32b472b8f5 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: f8993421-0b03-4554-aa82-b608a3baebe2] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:47.972204 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ea030d36-a11f-406f-9a8e-0f32b472b8f5 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:47.972690 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ea030d36-a11f-406f-9a8e-0f32b472b8f5 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:47.973124 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ea030d36-a11f-406f-9a8e-0f32b472b8f5 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:47.973847 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ea030d36-a11f-406f-9a8e-0f32b472b8f5 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:47.974301 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ea030d36-a11f-406f-9a8e-0f32b472b8f5 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:47.974724 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ea030d36-a11f-406f-9a8e-0f32b472b8f5 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:48.099972 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-ea030d36-a11f-406f-9a8e-0f32b472b8f5 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:48.107677 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-ea030d36-a11f-406f-9a8e-0f32b472b8f5 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2" status: 200 len: 1367 microversion: 2.1 time: 0.147404 Oct 03 14:55:48.108247 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 213/454] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:47 2022] GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:48.836848 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-a13d4bf7-45d3-44e6-a31c-c338b743c6de tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:48.837458 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-a13d4bf7-45d3-44e6-a31c-c338b743c6de tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:48.843996 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a13d4bf7-45d3-44e6-a31c-c338b743c6de tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:48.844472 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a13d4bf7-45d3-44e6-a31c-c338b743c6de tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:48.844901 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a13d4bf7-45d3-44e6-a31c-c338b743c6de tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:48.845707 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a13d4bf7-45d3-44e6-a31c-c338b743c6de tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:48.846277 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a13d4bf7-45d3-44e6-a31c-c338b743c6de tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:48.846692 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a13d4bf7-45d3-44e6-a31c-c338b743c6de tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:48.975228 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-a13d4bf7-45d3-44e6-a31c-c338b743c6de tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:48.983624 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-a13d4bf7-45d3-44e6-a31c-c338b743c6de tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:48.985033 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-a13d4bf7-45d3-44e6-a31c-c338b743c6de tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:48.986248 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-a13d4bf7-45d3-44e6-a31c-c338b743c6de tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1724 microversion: 2.20 time: 0.153143 Oct 03 14:55:48.986799 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 242/455] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:55:48 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:55:49.132132 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-e220a361-5868-4473-a264-ba626aaa5410 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:49.132670 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-e220a361-5868-4473-a264-ba626aaa5410 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: f8993421-0b03-4554-aa82-b608a3baebe2] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:49.138990 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e220a361-5868-4473-a264-ba626aaa5410 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:49.139464 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e220a361-5868-4473-a264-ba626aaa5410 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:49.139924 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e220a361-5868-4473-a264-ba626aaa5410 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:49.140599 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e220a361-5868-4473-a264-ba626aaa5410 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:49.141054 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e220a361-5868-4473-a264-ba626aaa5410 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:49.141468 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e220a361-5868-4473-a264-ba626aaa5410 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:49.271619 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-e220a361-5868-4473-a264-ba626aaa5410 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:49.279867 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-e220a361-5868-4473-a264-ba626aaa5410 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2" status: 200 len: 1367 microversion: 2.1 time: 0.151667 Oct 03 14:55:49.280433 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 214/456] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:49 2022] GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:50.012132 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-9dac8df4-3c21-43c4-ba1a-0f4a040d8c4f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:50.013340 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-9dac8df4-3c21-43c4-ba1a-0f4a040d8c4f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:50.019481 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9dac8df4-3c21-43c4-ba1a-0f4a040d8c4f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:50.019959 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9dac8df4-3c21-43c4-ba1a-0f4a040d8c4f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:50.020393 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9dac8df4-3c21-43c4-ba1a-0f4a040d8c4f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:50.021085 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9dac8df4-3c21-43c4-ba1a-0f4a040d8c4f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:50.021555 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9dac8df4-3c21-43c4-ba1a-0f4a040d8c4f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:50.021980 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9dac8df4-3c21-43c4-ba1a-0f4a040d8c4f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:50.147316 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-9dac8df4-3c21-43c4-ba1a-0f4a040d8c4f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:50.155250 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-9dac8df4-3c21-43c4-ba1a-0f4a040d8c4f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:50.156673 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-9dac8df4-3c21-43c4-ba1a-0f4a040d8c4f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:50.157842 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-9dac8df4-3c21-43c4-ba1a-0f4a040d8c4f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1724 microversion: 2.20 time: 0.149565 Oct 03 14:55:50.158399 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 243/457] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:55:50 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:55:50.302714 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-2bdfcfe4-0340-4750-871b-39175ee2f08a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:50.303329 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-2bdfcfe4-0340-4750-871b-39175ee2f08a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: f8993421-0b03-4554-aa82-b608a3baebe2] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:50.310417 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2bdfcfe4-0340-4750-871b-39175ee2f08a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:50.310907 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2bdfcfe4-0340-4750-871b-39175ee2f08a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:50.311344 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2bdfcfe4-0340-4750-871b-39175ee2f08a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:50.312039 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2bdfcfe4-0340-4750-871b-39175ee2f08a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:50.312500 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2bdfcfe4-0340-4750-871b-39175ee2f08a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:50.312939 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2bdfcfe4-0340-4750-871b-39175ee2f08a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:50.438902 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-2bdfcfe4-0340-4750-871b-39175ee2f08a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:50.446359 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-2bdfcfe4-0340-4750-871b-39175ee2f08a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2" status: 200 len: 1367 microversion: 2.1 time: 0.147458 Oct 03 14:55:50.446914 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 215/458] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:50 2022] GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:51.181965 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-c8c47c71-ed29-4989-ae6e-0283986b2ab3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:51.182602 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-c8c47c71-ed29-4989-ae6e-0283986b2ab3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:51.188612 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c8c47c71-ed29-4989-ae6e-0283986b2ab3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:51.189113 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c8c47c71-ed29-4989-ae6e-0283986b2ab3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:51.189579 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c8c47c71-ed29-4989-ae6e-0283986b2ab3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:51.190265 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c8c47c71-ed29-4989-ae6e-0283986b2ab3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:51.190718 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c8c47c71-ed29-4989-ae6e-0283986b2ab3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:51.191139 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c8c47c71-ed29-4989-ae6e-0283986b2ab3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:51.320289 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-c8c47c71-ed29-4989-ae6e-0283986b2ab3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:51.328771 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-c8c47c71-ed29-4989-ae6e-0283986b2ab3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:51.330260 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-c8c47c71-ed29-4989-ae6e-0283986b2ab3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:51.331399 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-c8c47c71-ed29-4989-ae6e-0283986b2ab3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1724 microversion: 2.20 time: 0.153330 Oct 03 14:55:51.332144 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 244/459] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:55:51 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:55:51.468408 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-ba4d6707-3a19-4b4d-845e-d0e8b889fdca tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:51.469100 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-ba4d6707-3a19-4b4d-845e-d0e8b889fdca tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: f8993421-0b03-4554-aa82-b608a3baebe2] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:51.475504 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ba4d6707-3a19-4b4d-845e-d0e8b889fdca tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:51.475982 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ba4d6707-3a19-4b4d-845e-d0e8b889fdca tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:51.476411 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ba4d6707-3a19-4b4d-845e-d0e8b889fdca tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:51.477097 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ba4d6707-3a19-4b4d-845e-d0e8b889fdca tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:51.477571 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ba4d6707-3a19-4b4d-845e-d0e8b889fdca tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:51.477995 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ba4d6707-3a19-4b4d-845e-d0e8b889fdca tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:51.643588 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-ba4d6707-3a19-4b4d-845e-d0e8b889fdca tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:51.652552 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-ba4d6707-3a19-4b4d-845e-d0e8b889fdca tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2" status: 200 len: 1367 microversion: 2.1 time: 0.187762 Oct 03 14:55:51.653428 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 216/460] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:51 2022] GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:52.357966 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-fdc1b6ec-d844-4162-bd55-49d145b6ab3b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:52.358575 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-fdc1b6ec-d844-4162-bd55-49d145b6ab3b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:52.360529 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell0:SELECT=2 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:55:52.366077 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fdc1b6ec-d844-4162-bd55-49d145b6ab3b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:52.366526 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fdc1b6ec-d844-4162-bd55-49d145b6ab3b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:52.366968 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fdc1b6ec-d844-4162-bd55-49d145b6ab3b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:52.367552 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fdc1b6ec-d844-4162-bd55-49d145b6ab3b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:52.368010 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fdc1b6ec-d844-4162-bd55-49d145b6ab3b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:52.368434 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fdc1b6ec-d844-4162-bd55-49d145b6ab3b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:52.494581 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-fdc1b6ec-d844-4162-bd55-49d145b6ab3b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:52.502682 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-fdc1b6ec-d844-4162-bd55-49d145b6ab3b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:52.504133 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-fdc1b6ec-d844-4162-bd55-49d145b6ab3b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:52.505289 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-fdc1b6ec-d844-4162-bd55-49d145b6ab3b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1724 microversion: 2.20 time: 0.151881 Oct 03 14:55:52.505875 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 245/461] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:55:52 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:55:52.674585 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-0640da55-5ad4-4ad4-afa4-7b684cf2611c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:52.675204 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-0640da55-5ad4-4ad4-afa4-7b684cf2611c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: f8993421-0b03-4554-aa82-b608a3baebe2] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:52.677047 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell0:SELECT=2 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:55:52.677844 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell0:SELECT=10 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:55:52.684645 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0640da55-5ad4-4ad4-afa4-7b684cf2611c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:52.685129 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0640da55-5ad4-4ad4-afa4-7b684cf2611c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:52.685594 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0640da55-5ad4-4ad4-afa4-7b684cf2611c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:52.686305 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0640da55-5ad4-4ad4-afa4-7b684cf2611c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:52.686742 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0640da55-5ad4-4ad4-afa4-7b684cf2611c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:52.687163 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0640da55-5ad4-4ad4-afa4-7b684cf2611c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:53.032568 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-0640da55-5ad4-4ad4-afa4-7b684cf2611c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:53.040150 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-0640da55-5ad4-4ad4-afa4-7b684cf2611c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2" status: 200 len: 1367 microversion: 2.1 time: 0.369401 Oct 03 14:55:53.040712 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 217/462] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:52 2022] GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2 => generated 1367 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:53.530664 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-fbf6d85a-9790-4707-b1e0-702dd8c6702a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:53.531278 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-fbf6d85a-9790-4707-b1e0-702dd8c6702a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:53.537160 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fbf6d85a-9790-4707-b1e0-702dd8c6702a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:53.537678 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fbf6d85a-9790-4707-b1e0-702dd8c6702a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:53.538118 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fbf6d85a-9790-4707-b1e0-702dd8c6702a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:53.538815 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fbf6d85a-9790-4707-b1e0-702dd8c6702a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:53.539271 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fbf6d85a-9790-4707-b1e0-702dd8c6702a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:53.539693 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fbf6d85a-9790-4707-b1e0-702dd8c6702a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:53.665953 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-fbf6d85a-9790-4707-b1e0-702dd8c6702a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:53.675130 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-fbf6d85a-9790-4707-b1e0-702dd8c6702a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:53.676591 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-fbf6d85a-9790-4707-b1e0-702dd8c6702a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:53.677765 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-fbf6d85a-9790-4707-b1e0-702dd8c6702a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1724 microversion: 2.20 time: 0.150904 Oct 03 14:55:53.681170 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 246/463] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:55:53 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:55:54.062625 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-218eab64-1376-4929-8fd0-60fac674cac9 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:54.063226 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-218eab64-1376-4929-8fd0-60fac674cac9 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: f8993421-0b03-4554-aa82-b608a3baebe2] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:54.069728 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-218eab64-1376-4929-8fd0-60fac674cac9 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:54.070211 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-218eab64-1376-4929-8fd0-60fac674cac9 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:54.070738 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-218eab64-1376-4929-8fd0-60fac674cac9 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:54.071309 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-218eab64-1376-4929-8fd0-60fac674cac9 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:54.071765 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-218eab64-1376-4929-8fd0-60fac674cac9 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:54.072185 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-218eab64-1376-4929-8fd0-60fac674cac9 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:54.197795 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-218eab64-1376-4929-8fd0-60fac674cac9 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:54.205835 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-218eab64-1376-4929-8fd0-60fac674cac9 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2" status: 200 len: 1367 microversion: 2.1 time: 0.147011 Oct 03 14:55:54.206392 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 218/464] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:54 2022] GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:54.669746 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-d20e4786-8029-4a12-b38b-d917320fc1ab req-9edc330d-5a6b-4d63-b97c-2d4747f0e3b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8993421-0b03-4554-aa82-b608a3baebe2", "name": "network-vif-plugged", "status": "completed", "tag": "e2d275ba-9f0b-4940-b899-d1d6d34a79b3"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:55:54.679540 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-d20e4786-8029-4a12-b38b-d917320fc1ab req-9edc330d-5a6b-4d63-b97c-2d4747f0e3b5 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:54.680031 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-d20e4786-8029-4a12-b38b-d917320fc1ab req-9edc330d-5a6b-4d63-b97c-2d4747f0e3b5 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:54.680566 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-d20e4786-8029-4a12-b38b-d917320fc1ab req-9edc330d-5a6b-4d63-b97c-2d4747f0e3b5 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:54.692525 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-d20e4786-8029-4a12-b38b-d917320fc1ab req-9edc330d-5a6b-4d63-b97c-2d4747f0e3b5 service nova] Creating event network-vif-plugged:e2d275ba-9f0b-4940-b899-d1d6d34a79b3 for instance f8993421-0b03-4554-aa82-b608a3baebe2 on hv-cinder-85987 Oct 03 14:55:54.697810 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-d20e4786-8029-4a12-b38b-d917320fc1ab req-9edc330d-5a6b-4d63-b97c-2d4747f0e3b5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031832 Oct 03 14:55:54.698558 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 247/465] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:55:54.703552 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-6d6035f8-8d06-4e67-b7e9-474804043ad2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:54.704372 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-6d6035f8-8d06-4e67-b7e9-474804043ad2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:54.710461 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6d6035f8-8d06-4e67-b7e9-474804043ad2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:54.711020 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6d6035f8-8d06-4e67-b7e9-474804043ad2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:54.711463 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6d6035f8-8d06-4e67-b7e9-474804043ad2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:54.712155 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6d6035f8-8d06-4e67-b7e9-474804043ad2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:54.712608 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6d6035f8-8d06-4e67-b7e9-474804043ad2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:54.713031 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6d6035f8-8d06-4e67-b7e9-474804043ad2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:54.846617 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-6d6035f8-8d06-4e67-b7e9-474804043ad2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:54.854990 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-6d6035f8-8d06-4e67-b7e9-474804043ad2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:54.856954 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-6d6035f8-8d06-4e67-b7e9-474804043ad2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:54.858136 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-6d6035f8-8d06-4e67-b7e9-474804043ad2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1724 microversion: 2.20 time: 0.159216 Oct 03 14:55:54.858692 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 219/466] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:55:54 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:55:55.228501 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-3e670466-9e11-4dd0-9484-4cbdcb6bf141 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:55.229227 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-3e670466-9e11-4dd0-9484-4cbdcb6bf141 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: f8993421-0b03-4554-aa82-b608a3baebe2] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:55.235944 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3e670466-9e11-4dd0-9484-4cbdcb6bf141 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:55.236430 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3e670466-9e11-4dd0-9484-4cbdcb6bf141 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:55.236849 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3e670466-9e11-4dd0-9484-4cbdcb6bf141 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:55.237544 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3e670466-9e11-4dd0-9484-4cbdcb6bf141 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:55.237994 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3e670466-9e11-4dd0-9484-4cbdcb6bf141 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:55.238411 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3e670466-9e11-4dd0-9484-4cbdcb6bf141 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:55.367503 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-3e670466-9e11-4dd0-9484-4cbdcb6bf141 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:55.375664 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-3e670466-9e11-4dd0-9484-4cbdcb6bf141 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2" status: 200 len: 1367 microversion: 2.1 time: 0.151112 Oct 03 14:55:55.377679 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 248/467] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:55 2022] GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:55.885384 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-7604db63-547d-4079-9aed-c22fa946b65f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:55.886052 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-7604db63-547d-4079-9aed-c22fa946b65f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:55.893026 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7604db63-547d-4079-9aed-c22fa946b65f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:55.893560 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7604db63-547d-4079-9aed-c22fa946b65f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:55.893999 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7604db63-547d-4079-9aed-c22fa946b65f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:55.894687 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7604db63-547d-4079-9aed-c22fa946b65f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:55.895142 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7604db63-547d-4079-9aed-c22fa946b65f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:55.895568 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7604db63-547d-4079-9aed-c22fa946b65f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:56.024089 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-7604db63-547d-4079-9aed-c22fa946b65f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:56.032053 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-7604db63-547d-4079-9aed-c22fa946b65f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:56.033463 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-7604db63-547d-4079-9aed-c22fa946b65f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:56.034629 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-7604db63-547d-4079-9aed-c22fa946b65f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1724 microversion: 2.20 time: 0.153163 Oct 03 14:55:56.035182 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 220/468] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:55:55 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:55:56.397843 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-3e096d41-bd66-410f-9dee-c99b527dc5f7 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:56.398457 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-3e096d41-bd66-410f-9dee-c99b527dc5f7 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: f8993421-0b03-4554-aa82-b608a3baebe2] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:56.404456 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3e096d41-bd66-410f-9dee-c99b527dc5f7 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:56.404941 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3e096d41-bd66-410f-9dee-c99b527dc5f7 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:56.405382 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3e096d41-bd66-410f-9dee-c99b527dc5f7 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:56.406109 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3e096d41-bd66-410f-9dee-c99b527dc5f7 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:56.406568 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3e096d41-bd66-410f-9dee-c99b527dc5f7 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:56.406993 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3e096d41-bd66-410f-9dee-c99b527dc5f7 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:56.529645 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-3e096d41-bd66-410f-9dee-c99b527dc5f7 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:56.537090 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-3e096d41-bd66-410f-9dee-c99b527dc5f7 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2" status: 200 len: 1367 microversion: 2.1 time: 0.143113 Oct 03 14:55:56.537670 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 249/469] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:56 2022] GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2 => generated 1367 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:57.060459 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-9abff6d8-c651-4517-bf4f-3021e14d7212 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:57.061066 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-9abff6d8-c651-4517-bf4f-3021e14d7212 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:57.067332 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9abff6d8-c651-4517-bf4f-3021e14d7212 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:57.067809 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9abff6d8-c651-4517-bf4f-3021e14d7212 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:57.068238 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9abff6d8-c651-4517-bf4f-3021e14d7212 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:57.068913 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9abff6d8-c651-4517-bf4f-3021e14d7212 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:57.069384 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9abff6d8-c651-4517-bf4f-3021e14d7212 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:57.069831 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9abff6d8-c651-4517-bf4f-3021e14d7212 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:57.194029 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-9abff6d8-c651-4517-bf4f-3021e14d7212 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:57.201923 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-9abff6d8-c651-4517-bf4f-3021e14d7212 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:57.203350 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-9abff6d8-c651-4517-bf4f-3021e14d7212 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:57.204486 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-9abff6d8-c651-4517-bf4f-3021e14d7212 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1724 microversion: 2.20 time: 0.148701 Oct 03 14:55:57.205043 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 221/470] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:55:57 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:55:57.560220 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-2681ac00-e938-42c6-b694-e8d91e563e8d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:57.560830 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-2681ac00-e938-42c6-b694-e8d91e563e8d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: f8993421-0b03-4554-aa82-b608a3baebe2] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:57.566723 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2681ac00-e938-42c6-b694-e8d91e563e8d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:57.567200 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2681ac00-e938-42c6-b694-e8d91e563e8d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:57.567630 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2681ac00-e938-42c6-b694-e8d91e563e8d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:57.568338 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2681ac00-e938-42c6-b694-e8d91e563e8d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:57.568788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2681ac00-e938-42c6-b694-e8d91e563e8d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:57.569206 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2681ac00-e938-42c6-b694-e8d91e563e8d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:57.573131 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:55:57.965754 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-2681ac00-e938-42c6-b694-e8d91e563e8d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:57.973211 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-2681ac00-e938-42c6-b694-e8d91e563e8d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2" status: 200 len: 1367 microversion: 2.1 time: 0.416903 Oct 03 14:55:57.973796 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 250/471] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:57 2022] GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2 => generated 1367 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:58.230114 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-184f83b5-af62-480c-8ef6-1244db0f0656 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:58.230753 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-184f83b5-af62-480c-8ef6-1244db0f0656 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:58.237757 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-184f83b5-af62-480c-8ef6-1244db0f0656 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:58.238243 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-184f83b5-af62-480c-8ef6-1244db0f0656 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:58.238675 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-184f83b5-af62-480c-8ef6-1244db0f0656 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:58.239351 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-184f83b5-af62-480c-8ef6-1244db0f0656 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:58.239801 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-184f83b5-af62-480c-8ef6-1244db0f0656 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:58.240221 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-184f83b5-af62-480c-8ef6-1244db0f0656 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:58.372907 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-184f83b5-af62-480c-8ef6-1244db0f0656 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:58.380964 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-184f83b5-af62-480c-8ef6-1244db0f0656 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:58.382527 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-184f83b5-af62-480c-8ef6-1244db0f0656 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:58.383664 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-184f83b5-af62-480c-8ef6-1244db0f0656 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1724 microversion: 2.20 time: 0.157668 Oct 03 14:55:58.384214 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 222/472] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:55:58 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:55:58.996191 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-391a08d9-c065-4c70-9bd3-af37f8e74b20 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:58.997307 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-391a08d9-c065-4c70-9bd3-af37f8e74b20 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: f8993421-0b03-4554-aa82-b608a3baebe2] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:59.003223 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-391a08d9-c065-4c70-9bd3-af37f8e74b20 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:59.003704 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-391a08d9-c065-4c70-9bd3-af37f8e74b20 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:59.004143 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-391a08d9-c065-4c70-9bd3-af37f8e74b20 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:59.004831 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-391a08d9-c065-4c70-9bd3-af37f8e74b20 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:59.005283 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-391a08d9-c065-4c70-9bd3-af37f8e74b20 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:59.005734 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-391a08d9-c065-4c70-9bd3-af37f8e74b20 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:59.128855 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-391a08d9-c065-4c70-9bd3-af37f8e74b20 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:59.136689 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-391a08d9-c065-4c70-9bd3-af37f8e74b20 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2" status: 200 len: 1558 microversion: 2.1 time: 0.144366 Oct 03 14:55:59.138038 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 251/473] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:58 2022] GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2 => generated 1558 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:59.164197 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-c6e53196-4031-4019-a7b7-366b0d1c86e2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:59.164682 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-c6e53196-4031-4019-a7b7-366b0d1c86e2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: f8993421-0b03-4554-aa82-b608a3baebe2] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:59.166507 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=4 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:55:59.171707 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c6e53196-4031-4019-a7b7-366b0d1c86e2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:59.172184 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c6e53196-4031-4019-a7b7-366b0d1c86e2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:59.172614 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c6e53196-4031-4019-a7b7-366b0d1c86e2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:59.173294 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c6e53196-4031-4019-a7b7-366b0d1c86e2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:59.173770 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c6e53196-4031-4019-a7b7-366b0d1c86e2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:59.174192 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c6e53196-4031-4019-a7b7-366b0d1c86e2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:59.253258 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-c6e53196-4031-4019-a7b7-366b0d1c86e2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092804 Oct 03 14:55:59.253876 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 223/474] 10.222.0.46 () {58 vars in 1275 bytes} [Mon Oct 3 14:55:59 2022] GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:55:59.408762 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-576e211b-7ae1-4776-b875-40f8df910942 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:59.409466 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-576e211b-7ae1-4776-b875-40f8df910942 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:59.415477 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-576e211b-7ae1-4776-b875-40f8df910942 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:59.415969 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-576e211b-7ae1-4776-b875-40f8df910942 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:59.416406 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-576e211b-7ae1-4776-b875-40f8df910942 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:59.417100 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-576e211b-7ae1-4776-b875-40f8df910942 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:59.417580 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-576e211b-7ae1-4776-b875-40f8df910942 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:59.418002 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-576e211b-7ae1-4776-b875-40f8df910942 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:59.554293 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-576e211b-7ae1-4776-b875-40f8df910942 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:59.563255 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-576e211b-7ae1-4776-b875-40f8df910942 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:59.564693 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-576e211b-7ae1-4776-b875-40f8df910942 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:59.565883 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-576e211b-7ae1-4776-b875-40f8df910942 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1724 microversion: 2.20 time: 0.161282 Oct 03 14:55:59.566767 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 252/475] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:55:59 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:55:59.795991 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-e1b67f15-0adc-4954-8f35-1a65688fbf51 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1993079362", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-300642761", "security_groups": [{"name": "tempest-secgroup-smoke-583600217"}], "networks": [{"uuid": "8f5008e2-7fd3-43f9-93fb-273a94e61fe6"}], "block_device_mapping_v2": [{"uuid": "ef635719-f66f-456b-953f-c70586c131d5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:55:59.963825 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.network.neutron [None req-e1b67f15-0adc-4954-8f35-1a65688fbf51 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] validate_networks() for [('8f5008e2-7fd3-43f9-93fb-273a94e61fe6', None, None, None, None, None)] {{(pid=126852) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:56:00.450372 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-3771ce48-6db8-46ab-a450-bcec8e075c61 req-5a119f1f-a846-477e-b6fa-f52cd7d3be76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8993421-0b03-4554-aa82-b608a3baebe2", "tag": "e2d275ba-9f0b-4940-b899-d1d6d34a79b3"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:56:00.461946 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_api:SELECT=43 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:56:00.464297 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-3771ce48-6db8-46ab-a450-bcec8e075c61 req-5a119f1f-a846-477e-b6fa-f52cd7d3be76 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:00.465874 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-3771ce48-6db8-46ab-a450-bcec8e075c61 req-5a119f1f-a846-477e-b6fa-f52cd7d3be76 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:00.466824 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-3771ce48-6db8-46ab-a450-bcec8e075c61 req-5a119f1f-a846-477e-b6fa-f52cd7d3be76 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:00.482174 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-3771ce48-6db8-46ab-a450-bcec8e075c61 req-5a119f1f-a846-477e-b6fa-f52cd7d3be76 service nova] Creating event network-changed:e2d275ba-9f0b-4940-b899-d1d6d34a79b3 for instance f8993421-0b03-4554-aa82-b608a3baebe2 on hv-cinder-85987 Oct 03 14:56:00.487568 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-3771ce48-6db8-46ab-a450-bcec8e075c61 req-5a119f1f-a846-477e-b6fa-f52cd7d3be76 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042452 Oct 03 14:56:00.488742 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 253/476] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:56:00.577814 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-e1b67f15-0adc-4954-8f35-1a65688fbf51 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Flavor limits 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:56:00.578998 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-e1b67f15-0adc-4954-8f35-1a65688fbf51 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Image limits 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:56:00.579492 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-e1b67f15-0adc-4954-8f35-1a65688fbf51 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Flavor pref 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:56:00.579912 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-e1b67f15-0adc-4954-8f35-1a65688fbf51 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Image pref 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:56:00.580357 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-e1b67f15-0adc-4954-8f35-1a65688fbf51 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:56:00.590701 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e1b67f15-0adc-4954-8f35-1a65688fbf51 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:00.591496 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e1b67f15-0adc-4954-8f35-1a65688fbf51 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:00.592098 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e1b67f15-0adc-4954-8f35-1a65688fbf51 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:00.593184 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-efad4bf8-8f2a-4293-9b79-777389e8482a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:00.593345 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e1b67f15-0adc-4954-8f35-1a65688fbf51 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:00.593689 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e1b67f15-0adc-4954-8f35-1a65688fbf51 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:00.594124 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e1b67f15-0adc-4954-8f35-1a65688fbf51 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:00.595055 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-efad4bf8-8f2a-4293-9b79-777389e8482a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:00.601910 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-efad4bf8-8f2a-4293-9b79-777389e8482a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:00.602447 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-efad4bf8-8f2a-4293-9b79-777389e8482a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:00.603120 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-efad4bf8-8f2a-4293-9b79-777389e8482a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:00.604179 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-efad4bf8-8f2a-4293-9b79-777389e8482a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:00.604865 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-efad4bf8-8f2a-4293-9b79-777389e8482a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:00.605542 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-efad4bf8-8f2a-4293-9b79-777389e8482a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:00.613287 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-e1b67f15-0adc-4954-8f35-1a65688fbf51 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Getting quotas for project 8fae62571c3c402a8fcc4afaf4268310. Resources: {'ram', 'instances', 'cores'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:56:00.617387 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-e1b67f15-0adc-4954-8f35-1a65688fbf51 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Getting quotas for user 7725c72e89964487843bc9bd46b8e3d2 and project 8fae62571c3c402a8fcc4afaf4268310. Resources: {'ram', 'instances', 'cores'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:56:00.678552 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-e1b67f15-0adc-4954-8f35-1a65688fbf51 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Going to run 1 instances... {{(pid=126852) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:56:00.680809 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-e1b67f15-0adc-4954-8f35-1a65688fbf51 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ef635719-f66f-456b-953f-c70586c131d5',volume_size=None,volume_type=None)] {{(pid=126852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:56:00.784119 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-efad4bf8-8f2a-4293-9b79-777389e8482a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:00.796228 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-efad4bf8-8f2a-4293-9b79-777389e8482a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:00.797257 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-efad4bf8-8f2a-4293-9b79-777389e8482a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:00.799031 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-efad4bf8-8f2a-4293-9b79-777389e8482a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1745 microversion: 2.20 time: 0.211330 Oct 03 14:56:00.800142 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 254/477] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:00 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1745 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:00.855066 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-e1b67f15-0adc-4954-8f35-1a65688fbf51 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.062432 Oct 03 14:56:00.861977 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 224/478] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 3 14:55:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 1064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:56:00.868012 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-a8bc2710-56df-4e6c-9aa5-0ba43bc057dd tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:00.868626 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-a8bc2710-56df-4e6c-9aa5-0ba43bc057dd tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:00.938327 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-a8bc2710-56df-4e6c-9aa5-0ba43bc057dd tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:00.946830 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-a8bc2710-56df-4e6c-9aa5-0ba43bc057dd tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1088 microversion: 2.1 time: 0.083429 Oct 03 14:56:00.947728 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 255/479] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:00 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1088 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:56:01.835435 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-242887fc-d65b-4399-9b29-d8669ca875f2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:01.836132 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-242887fc-d65b-4399-9b29-d8669ca875f2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:01.843516 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-242887fc-d65b-4399-9b29-d8669ca875f2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:01.844092 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-242887fc-d65b-4399-9b29-d8669ca875f2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:01.844518 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-242887fc-d65b-4399-9b29-d8669ca875f2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:01.845239 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-242887fc-d65b-4399-9b29-d8669ca875f2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:01.845705 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-242887fc-d65b-4399-9b29-d8669ca875f2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:01.846131 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-242887fc-d65b-4399-9b29-d8669ca875f2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:01.850419 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=100 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:56:01.969804 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-982e5f5e-bdd9-470f-9d74-87b04fe619d4 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:01.970349 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-982e5f5e-bdd9-470f-9d74-87b04fe619d4 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:01.976385 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-982e5f5e-bdd9-470f-9d74-87b04fe619d4 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:01.976870 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-982e5f5e-bdd9-470f-9d74-87b04fe619d4 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:01.977307 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-982e5f5e-bdd9-470f-9d74-87b04fe619d4 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:01.978060 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-982e5f5e-bdd9-470f-9d74-87b04fe619d4 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:01.978601 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-982e5f5e-bdd9-470f-9d74-87b04fe619d4 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:01.978959 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-982e5f5e-bdd9-470f-9d74-87b04fe619d4 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:01.980889 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-242887fc-d65b-4399-9b29-d8669ca875f2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:01.988810 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-242887fc-d65b-4399-9b29-d8669ca875f2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:01.990440 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-242887fc-d65b-4399-9b29-d8669ca875f2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:01.991579 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-242887fc-d65b-4399-9b29-d8669ca875f2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1745 microversion: 2.20 time: 0.160029 Oct 03 14:56:01.992135 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 225/480] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:01 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:02.041752 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-982e5f5e-bdd9-470f-9d74-87b04fe619d4 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:02.049215 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-982e5f5e-bdd9-470f-9d74-87b04fe619d4 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1186 microversion: 2.1 time: 0.083326 Oct 03 14:56:02.049815 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 256/481] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:01 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1186 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:56:03.018258 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-921eeebc-c0f0-48a8-abfa-cfdf1e8c7482 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:03.018873 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-921eeebc-c0f0-48a8-abfa-cfdf1e8c7482 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:03.030724 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-921eeebc-c0f0-48a8-abfa-cfdf1e8c7482 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:03.031246 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-921eeebc-c0f0-48a8-abfa-cfdf1e8c7482 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:03.031881 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-921eeebc-c0f0-48a8-abfa-cfdf1e8c7482 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:03.032764 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-921eeebc-c0f0-48a8-abfa-cfdf1e8c7482 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:03.033225 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-921eeebc-c0f0-48a8-abfa-cfdf1e8c7482 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:03.033826 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-921eeebc-c0f0-48a8-abfa-cfdf1e8c7482 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:03.083585 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-273d4de1-6545-4fdf-a5f7-345d0d50e143 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:03.084342 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-273d4de1-6545-4fdf-a5f7-345d0d50e143 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:03.097532 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-273d4de1-6545-4fdf-a5f7-345d0d50e143 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:03.098225 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-273d4de1-6545-4fdf-a5f7-345d0d50e143 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:03.098843 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-273d4de1-6545-4fdf-a5f7-345d0d50e143 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:03.099874 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-273d4de1-6545-4fdf-a5f7-345d0d50e143 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:03.100505 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-273d4de1-6545-4fdf-a5f7-345d0d50e143 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:03.100928 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-273d4de1-6545-4fdf-a5f7-345d0d50e143 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:03.260556 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-921eeebc-c0f0-48a8-abfa-cfdf1e8c7482 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:03.271734 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-921eeebc-c0f0-48a8-abfa-cfdf1e8c7482 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:03.273178 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-921eeebc-c0f0-48a8-abfa-cfdf1e8c7482 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:03.274484 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-921eeebc-c0f0-48a8-abfa-cfdf1e8c7482 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1745 microversion: 2.20 time: 0.260104 Oct 03 14:56:03.284226 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 226/482] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:03 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1745 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:03.299719 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-273d4de1-6545-4fdf-a5f7-345d0d50e143 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:03.308389 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-273d4de1-6545-4fdf-a5f7-345d0d50e143 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1271 microversion: 2.1 time: 0.239952 Oct 03 14:56:03.309017 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 257/483] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:03 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1271 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:04.070518 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-30c2ed76-0a7b-4e8a-a54b-2d0774c5f775 req-10ab4a82-b763-4f88-b5f2-3cf71b9431dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe4e9466-74aa-4df2-8a80-8c79b26bc20e", "tag": "e321d3a6-46f2-4be4-9d86-b86c2bf327ff"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:56:04.080325 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-30c2ed76-0a7b-4e8a-a54b-2d0774c5f775 req-10ab4a82-b763-4f88-b5f2-3cf71b9431dd service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:04.080808 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-30c2ed76-0a7b-4e8a-a54b-2d0774c5f775 req-10ab4a82-b763-4f88-b5f2-3cf71b9431dd service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:04.081236 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-30c2ed76-0a7b-4e8a-a54b-2d0774c5f775 req-10ab4a82-b763-4f88-b5f2-3cf71b9431dd service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:04.092954 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-30c2ed76-0a7b-4e8a-a54b-2d0774c5f775 req-10ab4a82-b763-4f88-b5f2-3cf71b9431dd service nova] Creating event network-changed:e321d3a6-46f2-4be4-9d86-b86c2bf327ff for instance fe4e9466-74aa-4df2-8a80-8c79b26bc20e on hv-cinder-85987 Oct 03 14:56:04.097969 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-30c2ed76-0a7b-4e8a-a54b-2d0774c5f775 req-10ab4a82-b763-4f88-b5f2-3cf71b9431dd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030924 Oct 03 14:56:04.098553 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 227/484] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:56:04.301407 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-c90ca771-adf6-4983-8cbe-8679ddb864d2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:04.302249 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-c90ca771-adf6-4983-8cbe-8679ddb864d2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:04.308329 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c90ca771-adf6-4983-8cbe-8679ddb864d2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:04.308816 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c90ca771-adf6-4983-8cbe-8679ddb864d2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:04.309282 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c90ca771-adf6-4983-8cbe-8679ddb864d2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:04.310040 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c90ca771-adf6-4983-8cbe-8679ddb864d2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:04.310498 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c90ca771-adf6-4983-8cbe-8679ddb864d2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:04.310923 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c90ca771-adf6-4983-8cbe-8679ddb864d2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:04.332299 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-b41aa384-8ff3-4688-9078-e1ba2a10fa65 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:04.333234 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-b41aa384-8ff3-4688-9078-e1ba2a10fa65 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:04.339756 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b41aa384-8ff3-4688-9078-e1ba2a10fa65 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:04.341197 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b41aa384-8ff3-4688-9078-e1ba2a10fa65 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:04.353589 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b41aa384-8ff3-4688-9078-e1ba2a10fa65 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:04.355022 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b41aa384-8ff3-4688-9078-e1ba2a10fa65 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:04.356524 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b41aa384-8ff3-4688-9078-e1ba2a10fa65 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:04.357302 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b41aa384-8ff3-4688-9078-e1ba2a10fa65 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:04.440119 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-c90ca771-adf6-4983-8cbe-8679ddb864d2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:04.448366 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-c90ca771-adf6-4983-8cbe-8679ddb864d2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:04.449816 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-c90ca771-adf6-4983-8cbe-8679ddb864d2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:04.450977 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-c90ca771-adf6-4983-8cbe-8679ddb864d2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1745 microversion: 2.20 time: 0.153477 Oct 03 14:56:04.451541 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 258/485] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:04 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:04.587395 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-b41aa384-8ff3-4688-9078-e1ba2a10fa65 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:04.596249 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-b41aa384-8ff3-4688-9078-e1ba2a10fa65 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1259 microversion: 2.1 time: 0.268388 Oct 03 14:56:04.597357 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 228/486] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:04 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1259 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:56:04.697954 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-55e0e643-2a12-4e13-881a-f8dbff935cd7 req-5d909ec1-a56f-465b-95c6-ab2f6a96c3c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27879d6c-62f5-4281-b134-faecf706a2db", "name": "network-vif-plugged", "status": "completed", "tag": "abd33b94-cd03-47ad-bbbe-b38838da0555"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:56:04.708129 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-55e0e643-2a12-4e13-881a-f8dbff935cd7 req-5d909ec1-a56f-465b-95c6-ab2f6a96c3c8 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:04.708600 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-55e0e643-2a12-4e13-881a-f8dbff935cd7 req-5d909ec1-a56f-465b-95c6-ab2f6a96c3c8 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:04.709043 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-55e0e643-2a12-4e13-881a-f8dbff935cd7 req-5d909ec1-a56f-465b-95c6-ab2f6a96c3c8 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:04.721289 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-55e0e643-2a12-4e13-881a-f8dbff935cd7 req-5d909ec1-a56f-465b-95c6-ab2f6a96c3c8 service nova] Creating event network-vif-plugged:abd33b94-cd03-47ad-bbbe-b38838da0555 for instance 27879d6c-62f5-4281-b134-faecf706a2db on hv-cinder-85987 Oct 03 14:56:04.726018 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-55e0e643-2a12-4e13-881a-f8dbff935cd7 req-5d909ec1-a56f-465b-95c6-ab2f6a96c3c8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031759 Oct 03 14:56:04.726921 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 259/487] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:56:05.022024 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-1cc8f46e-4ef7-4293-859b-84a47cc4b7ba tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:05.022511 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-1cc8f46e-4ef7-4293-859b-84a47cc4b7ba tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:05.028698 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1cc8f46e-4ef7-4293-859b-84a47cc4b7ba tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:05.029210 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1cc8f46e-4ef7-4293-859b-84a47cc4b7ba tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:05.029673 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1cc8f46e-4ef7-4293-859b-84a47cc4b7ba tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:05.030359 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1cc8f46e-4ef7-4293-859b-84a47cc4b7ba tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:05.030808 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1cc8f46e-4ef7-4293-859b-84a47cc4b7ba tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:05.031226 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1cc8f46e-4ef7-4293-859b-84a47cc4b7ba tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:05.053811 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-1cc8f46e-4ef7-4293-859b-84a47cc4b7ba tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc/ips" status: 200 len: 146 microversion: 2.1 time: 0.035603 Oct 03 14:56:05.054369 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 229/488] 10.222.0.46 () {58 vars in 1248 bytes} [Mon Oct 3 14:56:05 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:56:05.477623 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-79fc2035-f840-4a1d-8397-092e61778a69 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:05.478319 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-79fc2035-f840-4a1d-8397-092e61778a69 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:05.484897 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-79fc2035-f840-4a1d-8397-092e61778a69 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:05.485377 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-79fc2035-f840-4a1d-8397-092e61778a69 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:05.485841 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-79fc2035-f840-4a1d-8397-092e61778a69 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:05.486528 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-79fc2035-f840-4a1d-8397-092e61778a69 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:05.486980 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-79fc2035-f840-4a1d-8397-092e61778a69 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:05.487401 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-79fc2035-f840-4a1d-8397-092e61778a69 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:05.615860 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-79fc2035-f840-4a1d-8397-092e61778a69 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:05.619570 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-ec3e5007-0485-445e-ad7d-47007651e419 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:05.620718 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-ec3e5007-0485-445e-ad7d-47007651e419 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:05.624466 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-79fc2035-f840-4a1d-8397-092e61778a69 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:05.625916 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-79fc2035-f840-4a1d-8397-092e61778a69 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:05.627065 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-79fc2035-f840-4a1d-8397-092e61778a69 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1745 microversion: 2.20 time: 0.153774 Oct 03 14:56:05.627618 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 260/489] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:05 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:05.627750 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ec3e5007-0485-445e-ad7d-47007651e419 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:05.628225 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ec3e5007-0485-445e-ad7d-47007651e419 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:05.628660 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ec3e5007-0485-445e-ad7d-47007651e419 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:05.629354 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ec3e5007-0485-445e-ad7d-47007651e419 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:05.629835 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ec3e5007-0485-445e-ad7d-47007651e419 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:05.630259 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ec3e5007-0485-445e-ad7d-47007651e419 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:05.760691 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-ec3e5007-0485-445e-ad7d-47007651e419 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:05.768524 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-ec3e5007-0485-445e-ad7d-47007651e419 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1259 microversion: 2.1 time: 0.153027 Oct 03 14:56:05.769167 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 230/490] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:05 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:56:06.652245 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-6919a6e9-6054-4e4e-be68-7b18a565d03d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:06.653095 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-6919a6e9-6054-4e4e-be68-7b18a565d03d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:06.659772 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6919a6e9-6054-4e4e-be68-7b18a565d03d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:06.660340 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6919a6e9-6054-4e4e-be68-7b18a565d03d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:06.660776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6919a6e9-6054-4e4e-be68-7b18a565d03d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:06.661609 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6919a6e9-6054-4e4e-be68-7b18a565d03d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:06.662349 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6919a6e9-6054-4e4e-be68-7b18a565d03d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:06.662774 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6919a6e9-6054-4e4e-be68-7b18a565d03d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:06.793675 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-2895fa22-2e4c-46ce-85b6-fbe4993c8d5b tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:06.795189 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-2895fa22-2e4c-46ce-85b6-fbe4993c8d5b tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:06.802179 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2895fa22-2e4c-46ce-85b6-fbe4993c8d5b tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:06.802860 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2895fa22-2e4c-46ce-85b6-fbe4993c8d5b tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:06.803466 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2895fa22-2e4c-46ce-85b6-fbe4993c8d5b tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:06.804338 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2895fa22-2e4c-46ce-85b6-fbe4993c8d5b tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:06.804679 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-6919a6e9-6054-4e4e-be68-7b18a565d03d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:06.805744 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2895fa22-2e4c-46ce-85b6-fbe4993c8d5b tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:06.806341 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2895fa22-2e4c-46ce-85b6-fbe4993c8d5b tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:06.816362 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-6919a6e9-6054-4e4e-be68-7b18a565d03d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:06.818116 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-6919a6e9-6054-4e4e-be68-7b18a565d03d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:06.819514 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-6919a6e9-6054-4e4e-be68-7b18a565d03d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1745 microversion: 2.20 time: 0.170945 Oct 03 14:56:06.820599 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 261/491] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:06 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:06.974217 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-2895fa22-2e4c-46ce-85b6-fbe4993c8d5b tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:06.982510 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-2895fa22-2e4c-46ce-85b6-fbe4993c8d5b tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1259 microversion: 2.1 time: 0.194948 Oct 03 14:56:06.983083 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 231/492] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:06 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1259 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:07.845140 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-b79b238e-ee32-4680-aa04-f4257923175c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:07.845775 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-b79b238e-ee32-4680-aa04-f4257923175c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:07.851677 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b79b238e-ee32-4680-aa04-f4257923175c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:07.852160 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b79b238e-ee32-4680-aa04-f4257923175c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:07.852594 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b79b238e-ee32-4680-aa04-f4257923175c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:07.853280 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b79b238e-ee32-4680-aa04-f4257923175c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:07.853763 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b79b238e-ee32-4680-aa04-f4257923175c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:07.854186 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b79b238e-ee32-4680-aa04-f4257923175c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:07.981860 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-b79b238e-ee32-4680-aa04-f4257923175c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:07.989911 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-b79b238e-ee32-4680-aa04-f4257923175c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:07.991354 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-b79b238e-ee32-4680-aa04-f4257923175c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:07.992515 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-b79b238e-ee32-4680-aa04-f4257923175c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1745 microversion: 2.20 time: 0.151272 Oct 03 14:56:07.993080 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 262/493] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:07 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:08.006732 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-e12e3383-4657-48aa-8d12-100eb78ba0c3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:08.007180 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-e12e3383-4657-48aa-8d12-100eb78ba0c3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:08.014250 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e12e3383-4657-48aa-8d12-100eb78ba0c3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:08.014731 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e12e3383-4657-48aa-8d12-100eb78ba0c3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:08.015160 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e12e3383-4657-48aa-8d12-100eb78ba0c3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:08.015845 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e12e3383-4657-48aa-8d12-100eb78ba0c3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:08.016294 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e12e3383-4657-48aa-8d12-100eb78ba0c3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:08.016713 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e12e3383-4657-48aa-8d12-100eb78ba0c3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:08.150267 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-e12e3383-4657-48aa-8d12-100eb78ba0c3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:08.157974 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-e12e3383-4657-48aa-8d12-100eb78ba0c3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1259 microversion: 2.1 time: 0.155482 Oct 03 14:56:08.158542 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 232/494] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:08 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:09.019149 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-272b8b18-219c-4ad3-8a99-655305070f5b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:09.019757 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-272b8b18-219c-4ad3-8a99-655305070f5b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:09.025801 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-272b8b18-219c-4ad3-8a99-655305070f5b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:09.026296 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-272b8b18-219c-4ad3-8a99-655305070f5b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:09.026727 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-272b8b18-219c-4ad3-8a99-655305070f5b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:09.027476 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-272b8b18-219c-4ad3-8a99-655305070f5b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:09.028469 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-272b8b18-219c-4ad3-8a99-655305070f5b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:09.028893 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-272b8b18-219c-4ad3-8a99-655305070f5b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:09.079954 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-60df2c44-9958-448a-be4e-6cec7e3ce46c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26524262-bab4-4557-b5db-0adf09b50258"}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:56:09.082525 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-60df2c44-9958-448a-be4e-6cec7e3ce46c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:09.089094 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-60df2c44-9958-448a-be4e-6cec7e3ce46c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:09.089969 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-60df2c44-9958-448a-be4e-6cec7e3ce46c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:09.090944 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-60df2c44-9958-448a-be4e-6cec7e3ce46c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:09.091903 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-60df2c44-9958-448a-be4e-6cec7e3ce46c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:09.092359 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-60df2c44-9958-448a-be4e-6cec7e3ce46c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:09.092781 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-60df2c44-9958-448a-be4e-6cec7e3ce46c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:09.160951 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-272b8b18-219c-4ad3-8a99-655305070f5b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:09.169940 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-272b8b18-219c-4ad3-8a99-655305070f5b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:09.171413 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-272b8b18-219c-4ad3-8a99-655305070f5b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:09.172570 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-272b8b18-219c-4ad3-8a99-655305070f5b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1745 microversion: 2.20 time: 0.157395 Oct 03 14:56:09.173203 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 263/495] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:09 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:09.179948 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-075da15f-9020-4e20-8f6f-4b3dac8b114b tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:09.180595 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-075da15f-9020-4e20-8f6f-4b3dac8b114b tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:09.186545 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-075da15f-9020-4e20-8f6f-4b3dac8b114b tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:09.187023 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-075da15f-9020-4e20-8f6f-4b3dac8b114b tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:09.187476 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-075da15f-9020-4e20-8f6f-4b3dac8b114b tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:09.188788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-075da15f-9020-4e20-8f6f-4b3dac8b114b tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:09.189317 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-075da15f-9020-4e20-8f6f-4b3dac8b114b tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:09.189926 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-075da15f-9020-4e20-8f6f-4b3dac8b114b tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:09.332741 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-075da15f-9020-4e20-8f6f-4b3dac8b114b tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:09.341443 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-075da15f-9020-4e20-8f6f-4b3dac8b114b tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1259 microversion: 2.1 time: 0.165139 Oct 03 14:56:09.342037 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 264/496] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:09 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:56:09.376988 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-60df2c44-9958-448a-be4e-6cec7e3ce46c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "POST /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300981 Oct 03 14:56:09.380164 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 233/497] 10.222.0.46 () {60 vars in 1323 bytes} [Mon Oct 3 14:56:09 2022] POST /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:56:10.198711 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-23f6642c-15bc-4878-b3ef-403e0ec2de29 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:10.199272 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-23f6642c-15bc-4878-b3ef-403e0ec2de29 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:10.205309 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-23f6642c-15bc-4878-b3ef-403e0ec2de29 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:10.205829 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-23f6642c-15bc-4878-b3ef-403e0ec2de29 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:10.206260 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-23f6642c-15bc-4878-b3ef-403e0ec2de29 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:10.206936 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-23f6642c-15bc-4878-b3ef-403e0ec2de29 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:10.207412 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-23f6642c-15bc-4878-b3ef-403e0ec2de29 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:10.207875 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-23f6642c-15bc-4878-b3ef-403e0ec2de29 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:10.342033 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-23f6642c-15bc-4878-b3ef-403e0ec2de29 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:10.350876 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-23f6642c-15bc-4878-b3ef-403e0ec2de29 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:10.352311 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-23f6642c-15bc-4878-b3ef-403e0ec2de29 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:10.353517 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-23f6642c-15bc-4878-b3ef-403e0ec2de29 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1745 microversion: 2.20 time: 0.158811 Oct 03 14:56:10.354075 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 265/498] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:10 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:10.365132 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-025cab13-6e92-4478-ab27-0ffebaa833ca tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:10.366267 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-025cab13-6e92-4478-ab27-0ffebaa833ca tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:10.372737 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-025cab13-6e92-4478-ab27-0ffebaa833ca tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:10.373217 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-025cab13-6e92-4478-ab27-0ffebaa833ca tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:10.373689 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-025cab13-6e92-4478-ab27-0ffebaa833ca tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:10.374378 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-025cab13-6e92-4478-ab27-0ffebaa833ca tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:10.374827 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-025cab13-6e92-4478-ab27-0ffebaa833ca tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:10.375249 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-025cab13-6e92-4478-ab27-0ffebaa833ca tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:10.507436 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-025cab13-6e92-4478-ab27-0ffebaa833ca tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:10.515732 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-025cab13-6e92-4478-ab27-0ffebaa833ca tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1259 microversion: 2.1 time: 0.155240 Oct 03 14:56:10.516284 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 234/499] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:10 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:56:11.380113 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-ce2953ca-1dba-4ad8-99d2-65edac9746fb tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:11.382134 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-ce2953ca-1dba-4ad8-99d2-65edac9746fb tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:11.385054 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell0:SELECT=2 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:56:11.397082 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ce2953ca-1dba-4ad8-99d2-65edac9746fb tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:11.397889 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ce2953ca-1dba-4ad8-99d2-65edac9746fb tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:11.398329 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ce2953ca-1dba-4ad8-99d2-65edac9746fb tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:11.399032 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ce2953ca-1dba-4ad8-99d2-65edac9746fb tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:11.399483 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ce2953ca-1dba-4ad8-99d2-65edac9746fb tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:11.399906 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ce2953ca-1dba-4ad8-99d2-65edac9746fb tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:11.532756 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-ce2953ca-1dba-4ad8-99d2-65edac9746fb tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:11.538932 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-97bb289a-7c8f-469b-9391-4bbcc3b746bb tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:11.539552 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-97bb289a-7c8f-469b-9391-4bbcc3b746bb tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:11.541486 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell0:SELECT=2 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:56:11.542720 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell0:SELECT=6 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:56:11.544809 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-ce2953ca-1dba-4ad8-99d2-65edac9746fb tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:11.546472 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-ce2953ca-1dba-4ad8-99d2-65edac9746fb tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:11.548741 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-ce2953ca-1dba-4ad8-99d2-65edac9746fb tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1740 microversion: 2.20 time: 0.172416 Oct 03 14:56:11.550046 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 266/500] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:11 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:56:11.553713 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-97bb289a-7c8f-469b-9391-4bbcc3b746bb tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:11.554378 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-97bb289a-7c8f-469b-9391-4bbcc3b746bb tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:11.554961 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-97bb289a-7c8f-469b-9391-4bbcc3b746bb tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:11.555960 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-97bb289a-7c8f-469b-9391-4bbcc3b746bb tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:11.556550 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-97bb289a-7c8f-469b-9391-4bbcc3b746bb tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:11.557773 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-97bb289a-7c8f-469b-9391-4bbcc3b746bb tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:11.698125 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-97bb289a-7c8f-469b-9391-4bbcc3b746bb tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:11.706311 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-97bb289a-7c8f-469b-9391-4bbcc3b746bb tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1259 microversion: 2.1 time: 0.171141 Oct 03 14:56:11.706871 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 235/501] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:11 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:56:12.576348 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-9734bba8-583e-43aa-b402-b3afeba2d5e1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:12.577116 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-9734bba8-583e-43aa-b402-b3afeba2d5e1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:12.583663 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9734bba8-583e-43aa-b402-b3afeba2d5e1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:12.587313 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9734bba8-583e-43aa-b402-b3afeba2d5e1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:12.588991 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9734bba8-583e-43aa-b402-b3afeba2d5e1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:12.592813 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9734bba8-583e-43aa-b402-b3afeba2d5e1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:12.593593 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9734bba8-583e-43aa-b402-b3afeba2d5e1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:12.594103 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9734bba8-583e-43aa-b402-b3afeba2d5e1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:12.736184 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-05466764-f879-45c3-a574-d992cb4c3567 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:12.740213 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-05466764-f879-45c3-a574-d992cb4c3567 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:12.759502 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-9734bba8-583e-43aa-b402-b3afeba2d5e1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:12.766428 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-05466764-f879-45c3-a574-d992cb4c3567 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:12.766914 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-05466764-f879-45c3-a574-d992cb4c3567 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:12.767523 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-05466764-f879-45c3-a574-d992cb4c3567 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:12.768635 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-05466764-f879-45c3-a574-d992cb4c3567 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:12.769256 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-05466764-f879-45c3-a574-d992cb4c3567 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:12.769852 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-05466764-f879-45c3-a574-d992cb4c3567 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:12.771248 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-9734bba8-583e-43aa-b402-b3afeba2d5e1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:12.773127 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-9734bba8-583e-43aa-b402-b3afeba2d5e1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:12.782677 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-9734bba8-583e-43aa-b402-b3afeba2d5e1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1740 microversion: 2.20 time: 0.210433 Oct 03 14:56:12.784351 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 267/502] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:12 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1740 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:13.000543 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-05466764-f879-45c3-a574-d992cb4c3567 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:13.010815 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-05466764-f879-45c3-a574-d992cb4c3567 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1259 microversion: 2.1 time: 0.284595 Oct 03 14:56:13.017973 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 236/503] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:12 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1259 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:13.813452 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-ff5ec108-c958-4c8d-befe-36f6150f14d7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:13.815007 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-ff5ec108-c958-4c8d-befe-36f6150f14d7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:13.822789 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ff5ec108-c958-4c8d-befe-36f6150f14d7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:13.823461 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ff5ec108-c958-4c8d-befe-36f6150f14d7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:13.823863 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ff5ec108-c958-4c8d-befe-36f6150f14d7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:13.825467 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ff5ec108-c958-4c8d-befe-36f6150f14d7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:13.826007 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ff5ec108-c958-4c8d-befe-36f6150f14d7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:13.826633 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ff5ec108-c958-4c8d-befe-36f6150f14d7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:13.966151 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-ff5ec108-c958-4c8d-befe-36f6150f14d7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:13.974062 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-ff5ec108-c958-4c8d-befe-36f6150f14d7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:13.975487 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-ff5ec108-c958-4c8d-befe-36f6150f14d7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:13.976634 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-ff5ec108-c958-4c8d-befe-36f6150f14d7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1740 microversion: 2.20 time: 0.167125 Oct 03 14:56:13.977177 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 268/504] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:13 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1740 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:14.035028 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-562f93d4-684d-4ec6-bdcc-0b741fd8a7cf tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:14.036896 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-562f93d4-684d-4ec6-bdcc-0b741fd8a7cf tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:14.044860 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-562f93d4-684d-4ec6-bdcc-0b741fd8a7cf tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:14.045578 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-562f93d4-684d-4ec6-bdcc-0b741fd8a7cf tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:14.046231 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-562f93d4-684d-4ec6-bdcc-0b741fd8a7cf tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:14.046934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-562f93d4-684d-4ec6-bdcc-0b741fd8a7cf tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:14.047395 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-562f93d4-684d-4ec6-bdcc-0b741fd8a7cf tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:14.047823 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-562f93d4-684d-4ec6-bdcc-0b741fd8a7cf tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:14.180475 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-562f93d4-684d-4ec6-bdcc-0b741fd8a7cf tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:14.189590 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-562f93d4-684d-4ec6-bdcc-0b741fd8a7cf tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1259 microversion: 2.1 time: 0.159254 Oct 03 14:56:14.190557 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 237/505] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:14 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:15.005989 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-18d17581-79b8-4f4b-89b8-fbbe4c5f66ee tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:15.006912 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-18d17581-79b8-4f4b-89b8-fbbe4c5f66ee tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:15.015096 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-18d17581-79b8-4f4b-89b8-fbbe4c5f66ee tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:15.015906 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-18d17581-79b8-4f4b-89b8-fbbe4c5f66ee tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:15.016535 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-18d17581-79b8-4f4b-89b8-fbbe4c5f66ee tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:15.017460 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-18d17581-79b8-4f4b-89b8-fbbe4c5f66ee tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:15.018140 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-18d17581-79b8-4f4b-89b8-fbbe4c5f66ee tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:15.018644 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-18d17581-79b8-4f4b-89b8-fbbe4c5f66ee tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:15.022903 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=100 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:56:15.163272 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-18d17581-79b8-4f4b-89b8-fbbe4c5f66ee tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:15.175282 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-18d17581-79b8-4f4b-89b8-fbbe4c5f66ee tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:15.176799 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-18d17581-79b8-4f4b-89b8-fbbe4c5f66ee tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:15.177989 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-18d17581-79b8-4f4b-89b8-fbbe4c5f66ee tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1740 microversion: 2.20 time: 0.175846 Oct 03 14:56:15.195633 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 269/506] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:15 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:15.217451 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-a1314448-8373-4723-bfb8-900f50717510 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:15.218781 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-a1314448-8373-4723-bfb8-900f50717510 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:15.225329 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a1314448-8373-4723-bfb8-900f50717510 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:15.225835 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a1314448-8373-4723-bfb8-900f50717510 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:15.226473 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a1314448-8373-4723-bfb8-900f50717510 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:15.227385 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a1314448-8373-4723-bfb8-900f50717510 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:15.227844 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a1314448-8373-4723-bfb8-900f50717510 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:15.228266 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a1314448-8373-4723-bfb8-900f50717510 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:15.391881 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-a1314448-8373-4723-bfb8-900f50717510 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:15.403645 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-a1314448-8373-4723-bfb8-900f50717510 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1259 microversion: 2.1 time: 0.190402 Oct 03 14:56:15.404908 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 238/507] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:15 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1259 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:16.215221 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-80c995af-e6e1-4365-b0be-64a61af360e9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:16.217185 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-80c995af-e6e1-4365-b0be-64a61af360e9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:16.224004 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-80c995af-e6e1-4365-b0be-64a61af360e9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:16.224720 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-80c995af-e6e1-4365-b0be-64a61af360e9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:16.225154 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-80c995af-e6e1-4365-b0be-64a61af360e9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:16.225887 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-80c995af-e6e1-4365-b0be-64a61af360e9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:16.226500 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-80c995af-e6e1-4365-b0be-64a61af360e9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:16.227089 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-80c995af-e6e1-4365-b0be-64a61af360e9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:16.367255 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-80c995af-e6e1-4365-b0be-64a61af360e9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:16.376061 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-80c995af-e6e1-4365-b0be-64a61af360e9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:16.377484 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-80c995af-e6e1-4365-b0be-64a61af360e9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:16.378653 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-80c995af-e6e1-4365-b0be-64a61af360e9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1740 microversion: 2.20 time: 0.170528 Oct 03 14:56:16.379208 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 270/508] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:16 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:16.429351 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-ab3ceecf-c42b-42f9-922f-4cd4349781cf tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:16.430136 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-ab3ceecf-c42b-42f9-922f-4cd4349781cf tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:16.437311 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ab3ceecf-c42b-42f9-922f-4cd4349781cf tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:16.438029 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ab3ceecf-c42b-42f9-922f-4cd4349781cf tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:16.438636 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ab3ceecf-c42b-42f9-922f-4cd4349781cf tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:16.439323 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ab3ceecf-c42b-42f9-922f-4cd4349781cf tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:16.439779 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ab3ceecf-c42b-42f9-922f-4cd4349781cf tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:16.440201 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ab3ceecf-c42b-42f9-922f-4cd4349781cf tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:16.618119 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-ab3ceecf-c42b-42f9-922f-4cd4349781cf tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:16.626771 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-ab3ceecf-c42b-42f9-922f-4cd4349781cf tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1259 microversion: 2.1 time: 0.201141 Oct 03 14:56:16.641267 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 239/509] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:16 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1259 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:17.234882 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-5a30099d-c7ef-4d93-8a2e-3247d692a1a8 req-5bf68cf2-9d48-4813-a5a7-81d940b61dab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe4e9466-74aa-4df2-8a80-8c79b26bc20e", "name": "network-vif-plugged", "status": "completed", "tag": "e321d3a6-46f2-4be4-9d86-b86c2bf327ff"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:56:17.244365 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-5a30099d-c7ef-4d93-8a2e-3247d692a1a8 req-5bf68cf2-9d48-4813-a5a7-81d940b61dab service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:17.246740 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-5a30099d-c7ef-4d93-8a2e-3247d692a1a8 req-5bf68cf2-9d48-4813-a5a7-81d940b61dab service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:17.247240 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-5a30099d-c7ef-4d93-8a2e-3247d692a1a8 req-5bf68cf2-9d48-4813-a5a7-81d940b61dab service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:17.271171 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-5a30099d-c7ef-4d93-8a2e-3247d692a1a8 req-5bf68cf2-9d48-4813-a5a7-81d940b61dab service nova] Creating event network-vif-plugged:e321d3a6-46f2-4be4-9d86-b86c2bf327ff for instance fe4e9466-74aa-4df2-8a80-8c79b26bc20e on hv-cinder-85987 Oct 03 14:56:17.281153 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-5a30099d-c7ef-4d93-8a2e-3247d692a1a8 req-5bf68cf2-9d48-4813-a5a7-81d940b61dab service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047159 Oct 03 14:56:17.281153 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 271/510] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:56:17.404354 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-e0bc8fa5-639d-413a-8056-fe3b72397291 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:17.404983 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-e0bc8fa5-639d-413a-8056-fe3b72397291 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:17.411136 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e0bc8fa5-639d-413a-8056-fe3b72397291 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:17.411625 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e0bc8fa5-639d-413a-8056-fe3b72397291 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:17.412063 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e0bc8fa5-639d-413a-8056-fe3b72397291 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:17.412778 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e0bc8fa5-639d-413a-8056-fe3b72397291 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:17.413387 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e0bc8fa5-639d-413a-8056-fe3b72397291 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:17.413700 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e0bc8fa5-639d-413a-8056-fe3b72397291 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:17.582580 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-e0bc8fa5-639d-413a-8056-fe3b72397291 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:17.595527 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-e0bc8fa5-639d-413a-8056-fe3b72397291 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:17.597087 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-e0bc8fa5-639d-413a-8056-fe3b72397291 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:17.599087 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-e0bc8fa5-639d-413a-8056-fe3b72397291 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1740 microversion: 2.20 time: 0.198532 Oct 03 14:56:17.599873 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 240/511] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:17 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1740 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:17.650377 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-d8b01de2-e742-4a74-8e70-cf371c978e78 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:17.651063 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-d8b01de2-e742-4a74-8e70-cf371c978e78 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:17.658171 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d8b01de2-e742-4a74-8e70-cf371c978e78 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:17.658873 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d8b01de2-e742-4a74-8e70-cf371c978e78 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:17.659309 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d8b01de2-e742-4a74-8e70-cf371c978e78 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:17.660112 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d8b01de2-e742-4a74-8e70-cf371c978e78 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:17.660564 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d8b01de2-e742-4a74-8e70-cf371c978e78 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:17.661154 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d8b01de2-e742-4a74-8e70-cf371c978e78 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:17.801034 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-d8b01de2-e742-4a74-8e70-cf371c978e78 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:17.811112 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-d8b01de2-e742-4a74-8e70-cf371c978e78 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1259 microversion: 2.1 time: 0.164961 Oct 03 14:56:17.812259 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 272/512] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:17 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:18.074379 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-c10b98c3-423b-418a-aeca-cd6a3fbfb402 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:56:18.081842 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c10b98c3-423b-418a-aeca-cd6a3fbfb402 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:18.082602 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c10b98c3-423b-418a-aeca-cd6a3fbfb402 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:18.083038 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c10b98c3-423b-418a-aeca-cd6a3fbfb402 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:18.139778 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:56:18.146654 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-c10b98c3-423b-418a-aeca-cd6a3fbfb402 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Going to try to stop instance {{(pid=126852) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 03 14:56:18.190209 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-c10b98c3-423b-418a-aeca-cd6a3fbfb402 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "POST /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc/action" status: 202 len: 0 microversion: 2.1 time: 0.119828 Oct 03 14:56:18.190747 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 241/513] 10.222.0.46 () {60 vars in 1278 bytes} [Mon Oct 3 14:56:18 2022] POST /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:56:18.199682 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-4c2b8747-7718-4a6f-b9a2-3117112e46a6 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:18.200380 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-4c2b8747-7718-4a6f-b9a2-3117112e46a6 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:18.206947 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4c2b8747-7718-4a6f-b9a2-3117112e46a6 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:18.207931 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4c2b8747-7718-4a6f-b9a2-3117112e46a6 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:18.208611 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4c2b8747-7718-4a6f-b9a2-3117112e46a6 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:18.209417 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4c2b8747-7718-4a6f-b9a2-3117112e46a6 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:18.209995 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4c2b8747-7718-4a6f-b9a2-3117112e46a6 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:18.210435 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4c2b8747-7718-4a6f-b9a2-3117112e46a6 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:18.351557 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-4c2b8747-7718-4a6f-b9a2-3117112e46a6 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:18.361116 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-4c2b8747-7718-4a6f-b9a2-3117112e46a6 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1719 microversion: 2.1 time: 0.165931 Oct 03 14:56:18.362037 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 273/514] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:18 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1719 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:18.627892 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-cc16bf9b-4e62-4824-b068-b5d09b5a2dd3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:18.628521 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-cc16bf9b-4e62-4824-b068-b5d09b5a2dd3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:18.643615 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cc16bf9b-4e62-4824-b068-b5d09b5a2dd3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:18.644109 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cc16bf9b-4e62-4824-b068-b5d09b5a2dd3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:18.644548 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cc16bf9b-4e62-4824-b068-b5d09b5a2dd3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:18.645258 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cc16bf9b-4e62-4824-b068-b5d09b5a2dd3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:18.645744 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cc16bf9b-4e62-4824-b068-b5d09b5a2dd3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:18.646170 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cc16bf9b-4e62-4824-b068-b5d09b5a2dd3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:18.803152 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-cc16bf9b-4e62-4824-b068-b5d09b5a2dd3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:18.812859 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-cc16bf9b-4e62-4824-b068-b5d09b5a2dd3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:18.814979 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-cc16bf9b-4e62-4824-b068-b5d09b5a2dd3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:18.816214 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-cc16bf9b-4e62-4824-b068-b5d09b5a2dd3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1740 microversion: 2.20 time: 0.193254 Oct 03 14:56:18.829590 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 242/515] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:18 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:18.833644 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-b18dd980-5c4d-4a6a-bd8e-c2d6918eff33 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:18.834452 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-b18dd980-5c4d-4a6a-bd8e-c2d6918eff33 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:18.840735 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b18dd980-5c4d-4a6a-bd8e-c2d6918eff33 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:18.841435 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b18dd980-5c4d-4a6a-bd8e-c2d6918eff33 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:18.842061 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b18dd980-5c4d-4a6a-bd8e-c2d6918eff33 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:18.842762 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b18dd980-5c4d-4a6a-bd8e-c2d6918eff33 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:18.843223 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b18dd980-5c4d-4a6a-bd8e-c2d6918eff33 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:18.843642 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b18dd980-5c4d-4a6a-bd8e-c2d6918eff33 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:18.984708 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-b18dd980-5c4d-4a6a-bd8e-c2d6918eff33 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:18.992656 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-b18dd980-5c4d-4a6a-bd8e-c2d6918eff33 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1259 microversion: 2.1 time: 0.162737 Oct 03 14:56:18.993421 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 274/516] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:18 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:19.385980 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-0c73a577-1150-4ac6-be51-6781e3f58927 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:19.387486 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-0c73a577-1150-4ac6-be51-6781e3f58927 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:19.393969 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0c73a577-1150-4ac6-be51-6781e3f58927 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:19.394723 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0c73a577-1150-4ac6-be51-6781e3f58927 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:19.395405 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0c73a577-1150-4ac6-be51-6781e3f58927 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:19.396183 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0c73a577-1150-4ac6-be51-6781e3f58927 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:19.396709 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0c73a577-1150-4ac6-be51-6781e3f58927 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:19.397219 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0c73a577-1150-4ac6-be51-6781e3f58927 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:19.534801 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-0c73a577-1150-4ac6-be51-6781e3f58927 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:19.543788 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-0c73a577-1150-4ac6-be51-6781e3f58927 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1719 microversion: 2.1 time: 0.161555 Oct 03 14:56:19.544278 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 243/517] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:19 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1719 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:19.842946 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-c5d56904-a1ca-4b1e-8aed-6bd579ac4584 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:19.843555 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-c5d56904-a1ca-4b1e-8aed-6bd579ac4584 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:19.849831 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c5d56904-a1ca-4b1e-8aed-6bd579ac4584 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:19.850319 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c5d56904-a1ca-4b1e-8aed-6bd579ac4584 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:19.850760 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c5d56904-a1ca-4b1e-8aed-6bd579ac4584 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:19.851447 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c5d56904-a1ca-4b1e-8aed-6bd579ac4584 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:19.851906 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c5d56904-a1ca-4b1e-8aed-6bd579ac4584 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:19.852331 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c5d56904-a1ca-4b1e-8aed-6bd579ac4584 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:20.007283 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-c5d56904-a1ca-4b1e-8aed-6bd579ac4584 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:20.016233 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-c5d56904-a1ca-4b1e-8aed-6bd579ac4584 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:20.017475 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-91ad578e-90ba-49e5-9b41-d6e1d78e1300 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:20.017987 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-c5d56904-a1ca-4b1e-8aed-6bd579ac4584 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:20.018247 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-91ad578e-90ba-49e5-9b41-d6e1d78e1300 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:20.018837 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-c5d56904-a1ca-4b1e-8aed-6bd579ac4584 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1740 microversion: 2.20 time: 0.179832 Oct 03 14:56:20.025536 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 275/518] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:19 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:20.032417 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-91ad578e-90ba-49e5-9b41-d6e1d78e1300 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:20.033013 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-91ad578e-90ba-49e5-9b41-d6e1d78e1300 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:20.033571 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-91ad578e-90ba-49e5-9b41-d6e1d78e1300 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:20.034519 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-91ad578e-90ba-49e5-9b41-d6e1d78e1300 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:20.035176 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-91ad578e-90ba-49e5-9b41-d6e1d78e1300 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:20.035870 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-91ad578e-90ba-49e5-9b41-d6e1d78e1300 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:20.186270 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-91ad578e-90ba-49e5-9b41-d6e1d78e1300 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:20.194568 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-91ad578e-90ba-49e5-9b41-d6e1d78e1300 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1441 microversion: 2.1 time: 0.181570 Oct 03 14:56:20.195408 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 244/519] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:20 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1441 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:20.234399 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-4c09484d-e5a5-41ae-80eb-635cbda00f32 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:20.235616 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-4c09484d-e5a5-41ae-80eb-635cbda00f32 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:20.244767 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4c09484d-e5a5-41ae-80eb-635cbda00f32 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:20.245658 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4c09484d-e5a5-41ae-80eb-635cbda00f32 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:20.246283 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4c09484d-e5a5-41ae-80eb-635cbda00f32 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:20.247134 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4c09484d-e5a5-41ae-80eb-635cbda00f32 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:20.247783 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4c09484d-e5a5-41ae-80eb-635cbda00f32 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:20.248514 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4c09484d-e5a5-41ae-80eb-635cbda00f32 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:20.406730 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-4c09484d-e5a5-41ae-80eb-635cbda00f32 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:20.414645 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-4c09484d-e5a5-41ae-80eb-635cbda00f32 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1441 microversion: 2.1 time: 0.185473 Oct 03 14:56:20.417039 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 276/520] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:20 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1441 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:56:20.567931 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-fa0b0d45-bfa6-4a50-874d-d6b2b5ba7623 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:20.568981 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-fa0b0d45-bfa6-4a50-874d-d6b2b5ba7623 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:20.575700 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fa0b0d45-bfa6-4a50-874d-d6b2b5ba7623 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:20.576179 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fa0b0d45-bfa6-4a50-874d-d6b2b5ba7623 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:20.576807 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fa0b0d45-bfa6-4a50-874d-d6b2b5ba7623 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:20.577811 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fa0b0d45-bfa6-4a50-874d-d6b2b5ba7623 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:20.578424 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fa0b0d45-bfa6-4a50-874d-d6b2b5ba7623 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:20.579001 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fa0b0d45-bfa6-4a50-874d-d6b2b5ba7623 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:20.785277 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-fa0b0d45-bfa6-4a50-874d-d6b2b5ba7623 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:20.795805 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-fa0b0d45-bfa6-4a50-874d-d6b2b5ba7623 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1719 microversion: 2.1 time: 0.231754 Oct 03 14:56:20.799232 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 245/521] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:20 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1719 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:21.044193 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-235087b7-95fc-4a7a-a8a8-733631a788f5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:21.044797 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-235087b7-95fc-4a7a-a8a8-733631a788f5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:21.051105 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-235087b7-95fc-4a7a-a8a8-733631a788f5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:21.051964 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-235087b7-95fc-4a7a-a8a8-733631a788f5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:21.052632 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-235087b7-95fc-4a7a-a8a8-733631a788f5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:21.053631 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-235087b7-95fc-4a7a-a8a8-733631a788f5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:21.054324 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-235087b7-95fc-4a7a-a8a8-733631a788f5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:21.054955 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-235087b7-95fc-4a7a-a8a8-733631a788f5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:21.263282 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-235087b7-95fc-4a7a-a8a8-733631a788f5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:21.273256 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-235087b7-95fc-4a7a-a8a8-733631a788f5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:21.275133 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-235087b7-95fc-4a7a-a8a8-733631a788f5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:21.277457 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-235087b7-95fc-4a7a-a8a8-733631a788f5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1740 microversion: 2.20 time: 0.236297 Oct 03 14:56:21.290152 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 277/522] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:21 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1740 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:21.825084 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-feb53d61-8c5e-4fe4-8f34-3bb8fb8e7389 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:21.826571 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-feb53d61-8c5e-4fe4-8f34-3bb8fb8e7389 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:21.835600 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-feb53d61-8c5e-4fe4-8f34-3bb8fb8e7389 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:21.836429 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-feb53d61-8c5e-4fe4-8f34-3bb8fb8e7389 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:21.837046 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-feb53d61-8c5e-4fe4-8f34-3bb8fb8e7389 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:21.838227 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-feb53d61-8c5e-4fe4-8f34-3bb8fb8e7389 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:21.838835 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-feb53d61-8c5e-4fe4-8f34-3bb8fb8e7389 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:21.839973 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-feb53d61-8c5e-4fe4-8f34-3bb8fb8e7389 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:22.001623 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-feb53d61-8c5e-4fe4-8f34-3bb8fb8e7389 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:22.011597 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-feb53d61-8c5e-4fe4-8f34-3bb8fb8e7389 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1719 microversion: 2.1 time: 0.192731 Oct 03 14:56:22.012763 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 246/523] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:21 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1719 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:22.318667 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-872d7343-ee12-425d-b90c-19e4c8f56ca8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:22.319759 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-872d7343-ee12-425d-b90c-19e4c8f56ca8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:22.350383 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-872d7343-ee12-425d-b90c-19e4c8f56ca8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:22.350611 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-872d7343-ee12-425d-b90c-19e4c8f56ca8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:22.350984 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-872d7343-ee12-425d-b90c-19e4c8f56ca8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:22.351705 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-872d7343-ee12-425d-b90c-19e4c8f56ca8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:22.352622 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-872d7343-ee12-425d-b90c-19e4c8f56ca8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:22.352622 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-872d7343-ee12-425d-b90c-19e4c8f56ca8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:22.570401 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-872d7343-ee12-425d-b90c-19e4c8f56ca8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:22.579718 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-872d7343-ee12-425d-b90c-19e4c8f56ca8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:22.581322 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-872d7343-ee12-425d-b90c-19e4c8f56ca8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:22.582672 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-872d7343-ee12-425d-b90c-19e4c8f56ca8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1740 microversion: 2.20 time: 0.267810 Oct 03 14:56:22.583351 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 278/524] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:22 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1740 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:22.697881 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-ff72f493-4be4-480e-bb8e-02f0cf3dfd88 req-0a1c810f-b311-4fa8-8878-13ef48ea8de1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe4e9466-74aa-4df2-8a80-8c79b26bc20e", "tag": "e321d3a6-46f2-4be4-9d86-b86c2bf327ff"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:56:22.707481 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-ff72f493-4be4-480e-bb8e-02f0cf3dfd88 req-0a1c810f-b311-4fa8-8878-13ef48ea8de1 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:22.707952 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-ff72f493-4be4-480e-bb8e-02f0cf3dfd88 req-0a1c810f-b311-4fa8-8878-13ef48ea8de1 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:22.708428 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-ff72f493-4be4-480e-bb8e-02f0cf3dfd88 req-0a1c810f-b311-4fa8-8878-13ef48ea8de1 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:22.720064 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-ff72f493-4be4-480e-bb8e-02f0cf3dfd88 req-0a1c810f-b311-4fa8-8878-13ef48ea8de1 service nova] Creating event network-changed:e321d3a6-46f2-4be4-9d86-b86c2bf327ff for instance fe4e9466-74aa-4df2-8a80-8c79b26bc20e on hv-cinder-85987 Oct 03 14:56:22.724931 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-ff72f493-4be4-480e-bb8e-02f0cf3dfd88 req-0a1c810f-b311-4fa8-8878-13ef48ea8de1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031005 Oct 03 14:56:22.725558 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 247/525] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:56:23.035255 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-d4af1bcf-0d3f-4b4e-a696-f5e696d9abb8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:23.035868 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-d4af1bcf-0d3f-4b4e-a696-f5e696d9abb8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:23.041960 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d4af1bcf-0d3f-4b4e-a696-f5e696d9abb8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:23.043013 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d4af1bcf-0d3f-4b4e-a696-f5e696d9abb8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:23.043457 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d4af1bcf-0d3f-4b4e-a696-f5e696d9abb8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:23.044212 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d4af1bcf-0d3f-4b4e-a696-f5e696d9abb8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:23.044679 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d4af1bcf-0d3f-4b4e-a696-f5e696d9abb8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:23.045107 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d4af1bcf-0d3f-4b4e-a696-f5e696d9abb8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:23.177173 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-d4af1bcf-0d3f-4b4e-a696-f5e696d9abb8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:23.185441 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-d4af1bcf-0d3f-4b4e-a696-f5e696d9abb8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1719 microversion: 2.1 time: 0.154004 Oct 03 14:56:23.186038 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 279/526] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:23 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:23.610616 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-7daea67e-0d46-4004-80de-d2ec64a4e455 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:23.611289 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-7daea67e-0d46-4004-80de-d2ec64a4e455 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:23.617756 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7daea67e-0d46-4004-80de-d2ec64a4e455 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:23.618307 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7daea67e-0d46-4004-80de-d2ec64a4e455 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:23.618927 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7daea67e-0d46-4004-80de-d2ec64a4e455 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:23.619677 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7daea67e-0d46-4004-80de-d2ec64a4e455 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:23.620199 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7daea67e-0d46-4004-80de-d2ec64a4e455 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:23.621251 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7daea67e-0d46-4004-80de-d2ec64a4e455 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:23.769125 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-7daea67e-0d46-4004-80de-d2ec64a4e455 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:23.777291 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-7daea67e-0d46-4004-80de-d2ec64a4e455 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:23.778800 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-7daea67e-0d46-4004-80de-d2ec64a4e455 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:23.779952 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-7daea67e-0d46-4004-80de-d2ec64a4e455 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1740 microversion: 2.20 time: 0.174336 Oct 03 14:56:23.780509 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 248/527] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:23 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:24.208791 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-52714853-4cbc-4de3-9004-48fee4468c8a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:24.209400 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-52714853-4cbc-4de3-9004-48fee4468c8a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:24.215590 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-52714853-4cbc-4de3-9004-48fee4468c8a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:24.216075 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-52714853-4cbc-4de3-9004-48fee4468c8a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:24.216546 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-52714853-4cbc-4de3-9004-48fee4468c8a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:24.217232 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-52714853-4cbc-4de3-9004-48fee4468c8a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:24.217721 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-52714853-4cbc-4de3-9004-48fee4468c8a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:24.218147 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-52714853-4cbc-4de3-9004-48fee4468c8a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:24.349368 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-52714853-4cbc-4de3-9004-48fee4468c8a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:24.358114 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-52714853-4cbc-4de3-9004-48fee4468c8a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1719 microversion: 2.1 time: 0.153183 Oct 03 14:56:24.358689 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 280/528] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:24 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:24.804144 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-d47dc762-e963-4c52-bdd5-eaf2a4284370 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:24.804750 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-d47dc762-e963-4c52-bdd5-eaf2a4284370 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:24.811052 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d47dc762-e963-4c52-bdd5-eaf2a4284370 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:24.811533 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d47dc762-e963-4c52-bdd5-eaf2a4284370 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:24.811960 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d47dc762-e963-4c52-bdd5-eaf2a4284370 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:24.812642 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d47dc762-e963-4c52-bdd5-eaf2a4284370 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:24.813089 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d47dc762-e963-4c52-bdd5-eaf2a4284370 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:24.813522 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d47dc762-e963-4c52-bdd5-eaf2a4284370 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:24.936617 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-d47dc762-e963-4c52-bdd5-eaf2a4284370 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:24.944544 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-d47dc762-e963-4c52-bdd5-eaf2a4284370 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:24.945995 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-d47dc762-e963-4c52-bdd5-eaf2a4284370 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:24.947134 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-d47dc762-e963-4c52-bdd5-eaf2a4284370 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1722 microversion: 2.20 time: 0.146864 Oct 03 14:56:24.947682 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 249/529] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:24 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:25.381668 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-f395f8a1-d8f7-4e31-824c-018117439fc3 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:25.382316 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-f395f8a1-d8f7-4e31-824c-018117439fc3 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:25.388857 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f395f8a1-d8f7-4e31-824c-018117439fc3 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:25.389338 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f395f8a1-d8f7-4e31-824c-018117439fc3 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:25.389810 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f395f8a1-d8f7-4e31-824c-018117439fc3 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:25.390502 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f395f8a1-d8f7-4e31-824c-018117439fc3 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:25.390966 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f395f8a1-d8f7-4e31-824c-018117439fc3 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:25.391402 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f395f8a1-d8f7-4e31-824c-018117439fc3 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:25.514600 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-f395f8a1-d8f7-4e31-824c-018117439fc3 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:25.522923 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-f395f8a1-d8f7-4e31-824c-018117439fc3 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1719 microversion: 2.1 time: 0.145196 Oct 03 14:56:25.523493 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 281/530] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:25 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1719 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:25.973769 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-4023724d-cf5b-40da-a25c-eca81e563006 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:25.974362 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-4023724d-cf5b-40da-a25c-eca81e563006 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:25.981254 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4023724d-cf5b-40da-a25c-eca81e563006 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:25.981754 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4023724d-cf5b-40da-a25c-eca81e563006 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:25.982185 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4023724d-cf5b-40da-a25c-eca81e563006 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:25.982863 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4023724d-cf5b-40da-a25c-eca81e563006 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:25.983312 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4023724d-cf5b-40da-a25c-eca81e563006 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:25.983729 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4023724d-cf5b-40da-a25c-eca81e563006 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:26.110314 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-4023724d-cf5b-40da-a25c-eca81e563006 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:26.118588 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-4023724d-cf5b-40da-a25c-eca81e563006 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:26.120014 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-4023724d-cf5b-40da-a25c-eca81e563006 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:26.121155 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-4023724d-cf5b-40da-a25c-eca81e563006 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1722 microversion: 2.20 time: 0.151293 Oct 03 14:56:26.121749 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 250/531] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:25 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:26.546538 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-dc45ba77-f305-416c-8a78-f5f3eb42d6bc tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:26.547159 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-dc45ba77-f305-416c-8a78-f5f3eb42d6bc tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:26.553064 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dc45ba77-f305-416c-8a78-f5f3eb42d6bc tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:26.553591 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dc45ba77-f305-416c-8a78-f5f3eb42d6bc tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:26.554032 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dc45ba77-f305-416c-8a78-f5f3eb42d6bc tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:26.554721 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dc45ba77-f305-416c-8a78-f5f3eb42d6bc tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:26.555180 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dc45ba77-f305-416c-8a78-f5f3eb42d6bc tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:26.555606 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dc45ba77-f305-416c-8a78-f5f3eb42d6bc tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:26.683431 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-dc45ba77-f305-416c-8a78-f5f3eb42d6bc tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:26.691534 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-dc45ba77-f305-416c-8a78-f5f3eb42d6bc tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1719 microversion: 2.1 time: 0.149611 Oct 03 14:56:26.692096 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 282/532] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:26 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1719 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:27.146231 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-f546e0d0-46be-4577-8699-26e2a39f80d7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:27.147021 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-f546e0d0-46be-4577-8699-26e2a39f80d7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:27.154601 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f546e0d0-46be-4577-8699-26e2a39f80d7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:27.155162 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f546e0d0-46be-4577-8699-26e2a39f80d7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:27.155810 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f546e0d0-46be-4577-8699-26e2a39f80d7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:27.156593 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f546e0d0-46be-4577-8699-26e2a39f80d7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:27.157223 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f546e0d0-46be-4577-8699-26e2a39f80d7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:27.157678 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f546e0d0-46be-4577-8699-26e2a39f80d7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:27.159049 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-f9cc4f4a-af9f-40d9-8d9b-0914219a1451 req-6542238f-0651-4fea-8c4a-6b38ac39df1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27879d6c-62f5-4281-b134-faecf706a2db", "name": "network-vif-unplugged", "status": "completed", "tag": "abd33b94-cd03-47ad-bbbe-b38838da0555"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:56:27.182344 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-f9cc4f4a-af9f-40d9-8d9b-0914219a1451 req-6542238f-0651-4fea-8c4a-6b38ac39df1f service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:27.182917 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-f9cc4f4a-af9f-40d9-8d9b-0914219a1451 req-6542238f-0651-4fea-8c4a-6b38ac39df1f service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:27.183356 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-f9cc4f4a-af9f-40d9-8d9b-0914219a1451 req-6542238f-0651-4fea-8c4a-6b38ac39df1f service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:27.202469 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-f9cc4f4a-af9f-40d9-8d9b-0914219a1451 req-6542238f-0651-4fea-8c4a-6b38ac39df1f service nova] Creating event network-vif-unplugged:abd33b94-cd03-47ad-bbbe-b38838da0555 for instance 27879d6c-62f5-4281-b134-faecf706a2db on hv-cinder-85987 Oct 03 14:56:27.215504 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-f9cc4f4a-af9f-40d9-8d9b-0914219a1451 req-6542238f-0651-4fea-8c4a-6b38ac39df1f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059027 Oct 03 14:56:27.217605 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 283/533] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:56:27.298078 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-f546e0d0-46be-4577-8699-26e2a39f80d7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:27.306153 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-f546e0d0-46be-4577-8699-26e2a39f80d7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:27.307579 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-f546e0d0-46be-4577-8699-26e2a39f80d7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:27.308904 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-f546e0d0-46be-4577-8699-26e2a39f80d7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1725 microversion: 2.20 time: 0.166816 Oct 03 14:56:27.309528 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 251/534] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:27 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:27.334287 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-d85c5ac4-0b39-4881-afec-44c74c53e0d9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f08eecab-5fea-4092-870a-4ad477cf1fc5"}} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:56:27.336722 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-d85c5ac4-0b39-4881-afec-44c74c53e0d9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:27.344820 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d85c5ac4-0b39-4881-afec-44c74c53e0d9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:27.345306 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d85c5ac4-0b39-4881-afec-44c74c53e0d9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:27.345762 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d85c5ac4-0b39-4881-afec-44c74c53e0d9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:27.346623 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d85c5ac4-0b39-4881-afec-44c74c53e0d9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:27.347078 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d85c5ac4-0b39-4881-afec-44c74c53e0d9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:27.347496 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d85c5ac4-0b39-4881-afec-44c74c53e0d9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:27.613622 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:56:27.623925 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-d85c5ac4-0b39-4881-afec-44c74c53e0d9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "POST /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.294075 Oct 03 14:56:27.624514 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 284/535] 10.222.0.46 () {62 vars in 1364 bytes} [Mon Oct 3 14:56:27 2022] POST /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db/os-volume_attachments => generated 188 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:56:27.713777 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-4ac8272c-4d87-4930-a102-a4ed2d582116 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:27.714409 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-4ac8272c-4d87-4930-a102-a4ed2d582116 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:27.720187 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4ac8272c-4d87-4930-a102-a4ed2d582116 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:27.720640 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4ac8272c-4d87-4930-a102-a4ed2d582116 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:27.721073 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4ac8272c-4d87-4930-a102-a4ed2d582116 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:27.721787 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4ac8272c-4d87-4930-a102-a4ed2d582116 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:27.722238 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4ac8272c-4d87-4930-a102-a4ed2d582116 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:27.722658 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4ac8272c-4d87-4930-a102-a4ed2d582116 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:27.748813 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-0b45497c-639d-4370-b03f-6b5ba6c1c6c3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:56:27.749532 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-0b45497c-639d-4370-b03f-6b5ba6c1c6c3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:27.755963 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0b45497c-639d-4370-b03f-6b5ba6c1c6c3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:27.756444 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0b45497c-639d-4370-b03f-6b5ba6c1c6c3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:27.756881 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0b45497c-639d-4370-b03f-6b5ba6c1c6c3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:27.757603 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0b45497c-639d-4370-b03f-6b5ba6c1c6c3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:27.758066 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0b45497c-639d-4370-b03f-6b5ba6c1c6c3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:27.758490 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0b45497c-639d-4370-b03f-6b5ba6c1c6c3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:27.805738 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-0b45497c-639d-4370-b03f-6b5ba6c1c6c3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126851) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 03 14:56:27.864435 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-4ac8272c-4d87-4930-a102-a4ed2d582116 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:27.874789 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-4ac8272c-4d87-4930-a102-a4ed2d582116 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1719 microversion: 2.1 time: 0.164931 Oct 03 14:56:27.875669 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 252/536] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:27 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1719 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:27.892734 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-0b45497c-639d-4370-b03f-6b5ba6c1c6c3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "POST /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db/action" status: 202 len: 0 microversion: 2.20 time: 0.148366 Oct 03 14:56:27.893543 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 285/537] 10.222.0.46 () {62 vars in 1319 bytes} [Mon Oct 3 14:56:27 2022] POST /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 03 14:56:27.901409 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-dac5ee2d-5f31-4510-a8b6-01e515aafb51 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:27.902138 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-dac5ee2d-5f31-4510-a8b6-01e515aafb51 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:27.907978 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-dac5ee2d-5f31-4510-a8b6-01e515aafb51 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:27.908465 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-dac5ee2d-5f31-4510-a8b6-01e515aafb51 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:27.908901 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-dac5ee2d-5f31-4510-a8b6-01e515aafb51 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:27.909629 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-dac5ee2d-5f31-4510-a8b6-01e515aafb51 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:27.910092 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-dac5ee2d-5f31-4510-a8b6-01e515aafb51 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:27.910516 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-dac5ee2d-5f31-4510-a8b6-01e515aafb51 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:28.259249 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-dac5ee2d-5f31-4510-a8b6-01e515aafb51 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:28.268154 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-dac5ee2d-5f31-4510-a8b6-01e515aafb51 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:28.269606 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-dac5ee2d-5f31-4510-a8b6-01e515aafb51 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:28.270782 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-dac5ee2d-5f31-4510-a8b6-01e515aafb51 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1751 microversion: 2.20 time: 0.373205 Oct 03 14:56:28.271347 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 253/538] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:27 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1751 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:56:28.897953 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-8d8e5286-0f66-40ed-bb74-1cce396debb4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:28.898562 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-8d8e5286-0f66-40ed-bb74-1cce396debb4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:28.904845 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8d8e5286-0f66-40ed-bb74-1cce396debb4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:28.905456 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8d8e5286-0f66-40ed-bb74-1cce396debb4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:28.905945 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8d8e5286-0f66-40ed-bb74-1cce396debb4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:28.906633 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8d8e5286-0f66-40ed-bb74-1cce396debb4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:28.907176 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8d8e5286-0f66-40ed-bb74-1cce396debb4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:28.907627 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8d8e5286-0f66-40ed-bb74-1cce396debb4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:29.037139 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-8d8e5286-0f66-40ed-bb74-1cce396debb4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:29.045517 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-8d8e5286-0f66-40ed-bb74-1cce396debb4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1719 microversion: 2.1 time: 0.151369 Oct 03 14:56:29.046074 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 286/539] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:28 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:29.296588 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-1bd7e8f7-ed8e-4a6e-a190-f9b9f78bc57c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:29.297201 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-1bd7e8f7-ed8e-4a6e-a190-f9b9f78bc57c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:29.299727 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:56:29.304803 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1bd7e8f7-ed8e-4a6e-a190-f9b9f78bc57c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:29.305284 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1bd7e8f7-ed8e-4a6e-a190-f9b9f78bc57c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:29.305755 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1bd7e8f7-ed8e-4a6e-a190-f9b9f78bc57c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:29.306443 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1bd7e8f7-ed8e-4a6e-a190-f9b9f78bc57c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:29.306898 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1bd7e8f7-ed8e-4a6e-a190-f9b9f78bc57c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:29.307321 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1bd7e8f7-ed8e-4a6e-a190-f9b9f78bc57c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:29.434208 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-1bd7e8f7-ed8e-4a6e-a190-f9b9f78bc57c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:29.442646 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-1bd7e8f7-ed8e-4a6e-a190-f9b9f78bc57c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:29.444079 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-1bd7e8f7-ed8e-4a6e-a190-f9b9f78bc57c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:29.445229 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-1bd7e8f7-ed8e-4a6e-a190-f9b9f78bc57c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1753 microversion: 2.20 time: 0.153013 Oct 03 14:56:29.445831 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 254/540] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:29 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:30.068006 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-be94bc8f-2c23-4376-9869-b219bff820bf tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:30.068616 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-be94bc8f-2c23-4376-9869-b219bff820bf tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:30.075040 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-be94bc8f-2c23-4376-9869-b219bff820bf tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:30.075524 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-be94bc8f-2c23-4376-9869-b219bff820bf tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:30.075959 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-be94bc8f-2c23-4376-9869-b219bff820bf tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:30.076649 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-be94bc8f-2c23-4376-9869-b219bff820bf tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:30.077140 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-be94bc8f-2c23-4376-9869-b219bff820bf tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:30.077590 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-be94bc8f-2c23-4376-9869-b219bff820bf tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:30.211827 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-be94bc8f-2c23-4376-9869-b219bff820bf tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:30.221635 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-be94bc8f-2c23-4376-9869-b219bff820bf tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1719 microversion: 2.1 time: 0.157533 Oct 03 14:56:30.222201 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 287/541] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:30 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:30.470628 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-a935df8e-211c-473b-8670-9dad2d2ad166 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:30.471237 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-a935df8e-211c-473b-8670-9dad2d2ad166 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:30.477615 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a935df8e-211c-473b-8670-9dad2d2ad166 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:30.478096 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a935df8e-211c-473b-8670-9dad2d2ad166 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:30.478529 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a935df8e-211c-473b-8670-9dad2d2ad166 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:30.479215 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a935df8e-211c-473b-8670-9dad2d2ad166 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:30.479679 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a935df8e-211c-473b-8670-9dad2d2ad166 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:30.480104 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a935df8e-211c-473b-8670-9dad2d2ad166 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:30.604094 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-a935df8e-211c-473b-8670-9dad2d2ad166 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:30.612553 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-a935df8e-211c-473b-8670-9dad2d2ad166 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:30.614033 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-a935df8e-211c-473b-8670-9dad2d2ad166 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:30.615189 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-a935df8e-211c-473b-8670-9dad2d2ad166 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1809 microversion: 2.20 time: 0.148397 Oct 03 14:56:30.615745 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 255/542] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:30 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1809 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:31.244253 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-e95474a1-1fa0-42a5-b5ba-dbdfae24f809 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:31.244855 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-e95474a1-1fa0-42a5-b5ba-dbdfae24f809 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:31.246839 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:56:31.252201 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e95474a1-1fa0-42a5-b5ba-dbdfae24f809 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:31.252687 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e95474a1-1fa0-42a5-b5ba-dbdfae24f809 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:31.253128 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e95474a1-1fa0-42a5-b5ba-dbdfae24f809 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:31.253846 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e95474a1-1fa0-42a5-b5ba-dbdfae24f809 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:31.254305 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e95474a1-1fa0-42a5-b5ba-dbdfae24f809 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:31.254726 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e95474a1-1fa0-42a5-b5ba-dbdfae24f809 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:31.386733 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-e95474a1-1fa0-42a5-b5ba-dbdfae24f809 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:31.394871 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-e95474a1-1fa0-42a5-b5ba-dbdfae24f809 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1719 microversion: 2.1 time: 0.154482 Oct 03 14:56:31.395435 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 288/543] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:31 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:31.641592 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-3a411423-6c7c-4718-b6ed-645849a8c789 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:31.642543 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-3a411423-6c7c-4718-b6ed-645849a8c789 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:31.649011 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3a411423-6c7c-4718-b6ed-645849a8c789 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:31.649551 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3a411423-6c7c-4718-b6ed-645849a8c789 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:31.649965 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3a411423-6c7c-4718-b6ed-645849a8c789 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:31.650696 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3a411423-6c7c-4718-b6ed-645849a8c789 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:31.651796 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3a411423-6c7c-4718-b6ed-645849a8c789 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:31.652235 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3a411423-6c7c-4718-b6ed-645849a8c789 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:31.782504 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-3a411423-6c7c-4718-b6ed-645849a8c789 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:31.801162 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-3a411423-6c7c-4718-b6ed-645849a8c789 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:31.802780 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-3a411423-6c7c-4718-b6ed-645849a8c789 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:31.805110 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-3a411423-6c7c-4718-b6ed-645849a8c789 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1809 microversion: 2.20 time: 0.167378 Oct 03 14:56:31.805478 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 256/544] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:31 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:32.417627 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-8a35e336-4115-4050-8cb2-855f69a74e33 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:32.418242 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-8a35e336-4115-4050-8cb2-855f69a74e33 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:32.424339 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8a35e336-4115-4050-8cb2-855f69a74e33 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:32.424826 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8a35e336-4115-4050-8cb2-855f69a74e33 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:32.425269 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8a35e336-4115-4050-8cb2-855f69a74e33 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:32.426015 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8a35e336-4115-4050-8cb2-855f69a74e33 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:32.426482 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8a35e336-4115-4050-8cb2-855f69a74e33 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:32.426906 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8a35e336-4115-4050-8cb2-855f69a74e33 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:32.566948 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-8a35e336-4115-4050-8cb2-855f69a74e33 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:32.575703 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-8a35e336-4115-4050-8cb2-855f69a74e33 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1719 microversion: 2.1 time: 0.161979 Oct 03 14:56:32.576270 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 289/545] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:32 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1719 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:32.831151 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-f4cece5c-8303-46a5-bdaf-eb895a35f4da tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:32.832342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-f4cece5c-8303-46a5-bdaf-eb895a35f4da tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:32.839731 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f4cece5c-8303-46a5-bdaf-eb895a35f4da tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:32.840578 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f4cece5c-8303-46a5-bdaf-eb895a35f4da tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:32.841209 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f4cece5c-8303-46a5-bdaf-eb895a35f4da tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:32.842142 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f4cece5c-8303-46a5-bdaf-eb895a35f4da tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:32.842791 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f4cece5c-8303-46a5-bdaf-eb895a35f4da tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:32.843457 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f4cece5c-8303-46a5-bdaf-eb895a35f4da tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:32.980571 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-f4cece5c-8303-46a5-bdaf-eb895a35f4da tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:32.984190 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:56:32.990197 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-f4cece5c-8303-46a5-bdaf-eb895a35f4da tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:32.991622 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-f4cece5c-8303-46a5-bdaf-eb895a35f4da tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:32.992778 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-f4cece5c-8303-46a5-bdaf-eb895a35f4da tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1809 microversion: 2.20 time: 0.166197 Oct 03 14:56:32.993528 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 257/546] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:32 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:33.600239 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-eb69f391-27f3-49fd-a461-c38d2d78f925 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:33.600800 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-eb69f391-27f3-49fd-a461-c38d2d78f925 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:33.607554 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-eb69f391-27f3-49fd-a461-c38d2d78f925 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:33.608035 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-eb69f391-27f3-49fd-a461-c38d2d78f925 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:33.608470 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-eb69f391-27f3-49fd-a461-c38d2d78f925 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:33.609152 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-eb69f391-27f3-49fd-a461-c38d2d78f925 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:33.609640 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-eb69f391-27f3-49fd-a461-c38d2d78f925 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:33.610064 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-eb69f391-27f3-49fd-a461-c38d2d78f925 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:33.749422 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-eb69f391-27f3-49fd-a461-c38d2d78f925 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:33.759385 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-eb69f391-27f3-49fd-a461-c38d2d78f925 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1719 microversion: 2.1 time: 0.162923 Oct 03 14:56:33.760996 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 290/547] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:33 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:34.018567 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-7b4c00d6-4724-48a4-896b-d99f7cf8d473 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:34.019227 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-7b4c00d6-4724-48a4-896b-d99f7cf8d473 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:34.027577 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7b4c00d6-4724-48a4-896b-d99f7cf8d473 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:34.028061 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7b4c00d6-4724-48a4-896b-d99f7cf8d473 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:34.028548 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7b4c00d6-4724-48a4-896b-d99f7cf8d473 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:34.029385 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7b4c00d6-4724-48a4-896b-d99f7cf8d473 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:34.029938 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7b4c00d6-4724-48a4-896b-d99f7cf8d473 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:34.030549 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7b4c00d6-4724-48a4-896b-d99f7cf8d473 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:34.168630 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-7b4c00d6-4724-48a4-896b-d99f7cf8d473 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:34.177752 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-7b4c00d6-4724-48a4-896b-d99f7cf8d473 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:34.179174 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-7b4c00d6-4724-48a4-896b-d99f7cf8d473 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:34.180326 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-7b4c00d6-4724-48a4-896b-d99f7cf8d473 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1809 microversion: 2.20 time: 0.165812 Oct 03 14:56:34.180887 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 258/548] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:34 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:34.782516 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-4bbd5961-cc5c-4441-8226-a0921088c5b1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:34.783120 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-4bbd5961-cc5c-4441-8226-a0921088c5b1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:34.788929 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4bbd5961-cc5c-4441-8226-a0921088c5b1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:34.789407 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4bbd5961-cc5c-4441-8226-a0921088c5b1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:34.789866 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4bbd5961-cc5c-4441-8226-a0921088c5b1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:34.790545 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4bbd5961-cc5c-4441-8226-a0921088c5b1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:34.790998 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4bbd5961-cc5c-4441-8226-a0921088c5b1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:34.791417 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4bbd5961-cc5c-4441-8226-a0921088c5b1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:34.920920 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-4bbd5961-cc5c-4441-8226-a0921088c5b1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:34.929465 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-4bbd5961-cc5c-4441-8226-a0921088c5b1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1719 microversion: 2.1 time: 0.150613 Oct 03 14:56:34.930056 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 291/549] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:34 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:35.209586 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-214da8d3-4e9f-432e-87e4-e48c34820e7d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:35.210196 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-214da8d3-4e9f-432e-87e4-e48c34820e7d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:35.217277 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-214da8d3-4e9f-432e-87e4-e48c34820e7d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:35.217787 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-214da8d3-4e9f-432e-87e4-e48c34820e7d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:35.218217 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-214da8d3-4e9f-432e-87e4-e48c34820e7d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:35.218908 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-214da8d3-4e9f-432e-87e4-e48c34820e7d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:35.219361 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-214da8d3-4e9f-432e-87e4-e48c34820e7d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:35.219777 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-214da8d3-4e9f-432e-87e4-e48c34820e7d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:35.393233 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-214da8d3-4e9f-432e-87e4-e48c34820e7d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:35.403631 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-214da8d3-4e9f-432e-87e4-e48c34820e7d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:35.405186 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-214da8d3-4e9f-432e-87e4-e48c34820e7d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:35.406372 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-214da8d3-4e9f-432e-87e4-e48c34820e7d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1809 microversion: 2.20 time: 0.200914 Oct 03 14:56:35.406927 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 259/550] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:35 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1809 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:35.952230 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-660c505c-4a22-4d46-b483-102c830db0d2 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:35.952957 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-660c505c-4a22-4d46-b483-102c830db0d2 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:35.959902 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-660c505c-4a22-4d46-b483-102c830db0d2 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:35.960712 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-660c505c-4a22-4d46-b483-102c830db0d2 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:35.961353 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-660c505c-4a22-4d46-b483-102c830db0d2 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:35.962537 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-660c505c-4a22-4d46-b483-102c830db0d2 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:35.963189 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-660c505c-4a22-4d46-b483-102c830db0d2 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:35.963845 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-660c505c-4a22-4d46-b483-102c830db0d2 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:36.098036 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-660c505c-4a22-4d46-b483-102c830db0d2 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:36.106686 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-660c505c-4a22-4d46-b483-102c830db0d2 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1719 microversion: 2.1 time: 0.158924 Oct 03 14:56:36.107243 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 292/551] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:35 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:36.431158 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-a488e436-4c3b-4cf5-9be8-81e756a3e110 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:36.431752 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-a488e436-4c3b-4cf5-9be8-81e756a3e110 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:36.438613 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a488e436-4c3b-4cf5-9be8-81e756a3e110 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:36.439124 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a488e436-4c3b-4cf5-9be8-81e756a3e110 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:36.439568 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a488e436-4c3b-4cf5-9be8-81e756a3e110 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:36.440259 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a488e436-4c3b-4cf5-9be8-81e756a3e110 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:36.440716 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a488e436-4c3b-4cf5-9be8-81e756a3e110 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:36.441139 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a488e436-4c3b-4cf5-9be8-81e756a3e110 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:36.578283 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-a488e436-4c3b-4cf5-9be8-81e756a3e110 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:36.586777 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-a488e436-4c3b-4cf5-9be8-81e756a3e110 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:36.588476 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-a488e436-4c3b-4cf5-9be8-81e756a3e110 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:36.590199 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-a488e436-4c3b-4cf5-9be8-81e756a3e110 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1809 microversion: 2.20 time: 0.162999 Oct 03 14:56:36.590758 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 260/552] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:36 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:37.132183 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-8fb01930-3b2f-4852-890d-3bb95c8f63c7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:37.132784 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-8fb01930-3b2f-4852-890d-3bb95c8f63c7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:37.139831 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8fb01930-3b2f-4852-890d-3bb95c8f63c7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:37.140399 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8fb01930-3b2f-4852-890d-3bb95c8f63c7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:37.140904 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8fb01930-3b2f-4852-890d-3bb95c8f63c7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:37.141715 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8fb01930-3b2f-4852-890d-3bb95c8f63c7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:37.142262 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8fb01930-3b2f-4852-890d-3bb95c8f63c7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:37.142743 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8fb01930-3b2f-4852-890d-3bb95c8f63c7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:37.274231 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-8fb01930-3b2f-4852-890d-3bb95c8f63c7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:37.284106 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-8fb01930-3b2f-4852-890d-3bb95c8f63c7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1719 microversion: 2.1 time: 0.155638 Oct 03 14:56:37.287739 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 293/553] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:37 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:37.615892 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-4e6376f6-3656-47b1-8a6e-bb14ac289215 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:37.616518 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-4e6376f6-3656-47b1-8a6e-bb14ac289215 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:37.623572 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4e6376f6-3656-47b1-8a6e-bb14ac289215 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:37.624051 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4e6376f6-3656-47b1-8a6e-bb14ac289215 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:37.624481 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4e6376f6-3656-47b1-8a6e-bb14ac289215 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:37.625166 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4e6376f6-3656-47b1-8a6e-bb14ac289215 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:37.625649 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4e6376f6-3656-47b1-8a6e-bb14ac289215 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:37.626073 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4e6376f6-3656-47b1-8a6e-bb14ac289215 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:37.755623 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-4e6376f6-3656-47b1-8a6e-bb14ac289215 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:37.764424 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-4e6376f6-3656-47b1-8a6e-bb14ac289215 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:37.765881 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-4e6376f6-3656-47b1-8a6e-bb14ac289215 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:37.767041 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-4e6376f6-3656-47b1-8a6e-bb14ac289215 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1809 microversion: 2.20 time: 0.155030 Oct 03 14:56:37.767594 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 261/554] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:37 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:38.307738 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-a80c279e-83da-454b-b48f-cc3e618bc3ab tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:38.308349 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-a80c279e-83da-454b-b48f-cc3e618bc3ab tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:38.314464 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a80c279e-83da-454b-b48f-cc3e618bc3ab tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:38.314949 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a80c279e-83da-454b-b48f-cc3e618bc3ab tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:38.315385 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a80c279e-83da-454b-b48f-cc3e618bc3ab tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:38.316085 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a80c279e-83da-454b-b48f-cc3e618bc3ab tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:38.316542 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a80c279e-83da-454b-b48f-cc3e618bc3ab tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:38.316967 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a80c279e-83da-454b-b48f-cc3e618bc3ab tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:38.458150 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-a80c279e-83da-454b-b48f-cc3e618bc3ab tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:38.468068 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-a80c279e-83da-454b-b48f-cc3e618bc3ab tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1719 microversion: 2.1 time: 0.164104 Oct 03 14:56:38.469330 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 294/555] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:38 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1719 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:38.792832 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-65d34688-1ba3-4753-b3c4-ec9529b6a5e9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:38.793432 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-65d34688-1ba3-4753-b3c4-ec9529b6a5e9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:38.800029 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-65d34688-1ba3-4753-b3c4-ec9529b6a5e9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:38.800519 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-65d34688-1ba3-4753-b3c4-ec9529b6a5e9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:38.800954 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-65d34688-1ba3-4753-b3c4-ec9529b6a5e9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:38.801679 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-65d34688-1ba3-4753-b3c4-ec9529b6a5e9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:38.802135 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-65d34688-1ba3-4753-b3c4-ec9529b6a5e9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:38.802557 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-65d34688-1ba3-4753-b3c4-ec9529b6a5e9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:38.955861 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-65d34688-1ba3-4753-b3c4-ec9529b6a5e9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:38.965075 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-65d34688-1ba3-4753-b3c4-ec9529b6a5e9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:38.966565 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-65d34688-1ba3-4753-b3c4-ec9529b6a5e9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:38.967877 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-65d34688-1ba3-4753-b3c4-ec9529b6a5e9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1809 microversion: 2.20 time: 0.178803 Oct 03 14:56:38.969088 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 262/556] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:38 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:39.491296 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-642df864-7c19-4bc1-826c-fa0c46c245eb tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:39.491907 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-642df864-7c19-4bc1-826c-fa0c46c245eb tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:39.497929 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-642df864-7c19-4bc1-826c-fa0c46c245eb tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:39.498418 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-642df864-7c19-4bc1-826c-fa0c46c245eb tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:39.498856 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-642df864-7c19-4bc1-826c-fa0c46c245eb tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:39.499547 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-642df864-7c19-4bc1-826c-fa0c46c245eb tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:39.500011 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-642df864-7c19-4bc1-826c-fa0c46c245eb tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:39.500438 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-642df864-7c19-4bc1-826c-fa0c46c245eb tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:39.638439 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-642df864-7c19-4bc1-826c-fa0c46c245eb tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:39.647180 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-642df864-7c19-4bc1-826c-fa0c46c245eb tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1719 microversion: 2.1 time: 0.159704 Oct 03 14:56:39.647735 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 295/557] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:39 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1719 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:56:39.995355 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-26f74744-f3d7-41b1-927b-a20dbb59f652 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:39.995991 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-26f74744-f3d7-41b1-927b-a20dbb59f652 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:40.002931 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-26f74744-f3d7-41b1-927b-a20dbb59f652 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:40.003418 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-26f74744-f3d7-41b1-927b-a20dbb59f652 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:40.003846 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-26f74744-f3d7-41b1-927b-a20dbb59f652 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:40.004542 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-26f74744-f3d7-41b1-927b-a20dbb59f652 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:40.005128 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-26f74744-f3d7-41b1-927b-a20dbb59f652 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:40.005571 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-26f74744-f3d7-41b1-927b-a20dbb59f652 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:40.147814 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-26f74744-f3d7-41b1-927b-a20dbb59f652 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:40.156235 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-26f74744-f3d7-41b1-927b-a20dbb59f652 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:40.157678 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-26f74744-f3d7-41b1-927b-a20dbb59f652 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:40.158818 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-26f74744-f3d7-41b1-927b-a20dbb59f652 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1809 microversion: 2.20 time: 0.167719 Oct 03 14:56:40.159371 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 263/558] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:39 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:40.671499 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-7fbadb46-b6c9-4f26-b00a-5e37eee8bb62 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:40.672152 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-7fbadb46-b6c9-4f26-b00a-5e37eee8bb62 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:40.677906 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7fbadb46-b6c9-4f26-b00a-5e37eee8bb62 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:40.678384 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7fbadb46-b6c9-4f26-b00a-5e37eee8bb62 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:40.678815 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7fbadb46-b6c9-4f26-b00a-5e37eee8bb62 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:40.679497 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7fbadb46-b6c9-4f26-b00a-5e37eee8bb62 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:40.679948 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7fbadb46-b6c9-4f26-b00a-5e37eee8bb62 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:40.680395 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7fbadb46-b6c9-4f26-b00a-5e37eee8bb62 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:40.812701 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-7fbadb46-b6c9-4f26-b00a-5e37eee8bb62 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:40.821077 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-7fbadb46-b6c9-4f26-b00a-5e37eee8bb62 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1719 microversion: 2.1 time: 0.154013 Oct 03 14:56:40.833259 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 296/559] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:40 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:41.184836 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-a29e545f-b0a7-479e-b293-ccdc8f61c340 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:41.186304 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-a29e545f-b0a7-479e-b293-ccdc8f61c340 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:41.193240 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a29e545f-b0a7-479e-b293-ccdc8f61c340 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:41.193832 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a29e545f-b0a7-479e-b293-ccdc8f61c340 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:41.194375 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a29e545f-b0a7-479e-b293-ccdc8f61c340 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:41.195164 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a29e545f-b0a7-479e-b293-ccdc8f61c340 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:41.195691 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a29e545f-b0a7-479e-b293-ccdc8f61c340 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:41.196184 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a29e545f-b0a7-479e-b293-ccdc8f61c340 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:41.352698 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-a29e545f-b0a7-479e-b293-ccdc8f61c340 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:41.361467 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-a29e545f-b0a7-479e-b293-ccdc8f61c340 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:41.362909 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-a29e545f-b0a7-479e-b293-ccdc8f61c340 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:41.364048 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-a29e545f-b0a7-479e-b293-ccdc8f61c340 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1809 microversion: 2.20 time: 0.183525 Oct 03 14:56:41.364601 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 264/560] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:41 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:41.844462 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-5c771e66-68ac-42c2-a3ec-9d45b137ca8f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:41.845070 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-5c771e66-68ac-42c2-a3ec-9d45b137ca8f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:41.851064 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5c771e66-68ac-42c2-a3ec-9d45b137ca8f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:41.851533 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5c771e66-68ac-42c2-a3ec-9d45b137ca8f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:41.851961 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5c771e66-68ac-42c2-a3ec-9d45b137ca8f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:41.852639 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5c771e66-68ac-42c2-a3ec-9d45b137ca8f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:41.853087 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5c771e66-68ac-42c2-a3ec-9d45b137ca8f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:41.853529 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5c771e66-68ac-42c2-a3ec-9d45b137ca8f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:42.235149 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-5c771e66-68ac-42c2-a3ec-9d45b137ca8f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:42.243316 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-5c771e66-68ac-42c2-a3ec-9d45b137ca8f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1719 microversion: 2.1 time: 0.402723 Oct 03 14:56:42.250542 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 297/561] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:41 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1719 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:42.389396 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-8307ad60-522b-4533-ac92-3cde4d8f8c78 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:42.390028 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-8307ad60-522b-4533-ac92-3cde4d8f8c78 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:42.396373 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8307ad60-522b-4533-ac92-3cde4d8f8c78 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:42.396854 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8307ad60-522b-4533-ac92-3cde4d8f8c78 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:42.397293 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8307ad60-522b-4533-ac92-3cde4d8f8c78 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:42.398043 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8307ad60-522b-4533-ac92-3cde4d8f8c78 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:42.398497 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8307ad60-522b-4533-ac92-3cde4d8f8c78 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:42.398919 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8307ad60-522b-4533-ac92-3cde4d8f8c78 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:42.533173 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-8307ad60-522b-4533-ac92-3cde4d8f8c78 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:42.541692 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-8307ad60-522b-4533-ac92-3cde4d8f8c78 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:42.543121 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-8307ad60-522b-4533-ac92-3cde4d8f8c78 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:42.544270 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-8307ad60-522b-4533-ac92-3cde4d8f8c78 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1809 microversion: 2.20 time: 0.158857 Oct 03 14:56:42.544826 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 265/562] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:42 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:43.267280 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-cfceb994-2f19-46eb-8281-3906c05b56c7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:43.267881 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-cfceb994-2f19-46eb-8281-3906c05b56c7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:43.274097 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cfceb994-2f19-46eb-8281-3906c05b56c7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:43.274575 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cfceb994-2f19-46eb-8281-3906c05b56c7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:43.275007 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cfceb994-2f19-46eb-8281-3906c05b56c7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:43.275692 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cfceb994-2f19-46eb-8281-3906c05b56c7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:43.276144 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cfceb994-2f19-46eb-8281-3906c05b56c7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:43.276559 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cfceb994-2f19-46eb-8281-3906c05b56c7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:43.422263 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-cfceb994-2f19-46eb-8281-3906c05b56c7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:43.430621 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-cfceb994-2f19-46eb-8281-3906c05b56c7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1719 microversion: 2.1 time: 0.167707 Oct 03 14:56:43.431117 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 298/563] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:43 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1719 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:43.571159 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-d94ba409-8570-4803-9ba9-6e8bd6ba46ee tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:43.571767 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-d94ba409-8570-4803-9ba9-6e8bd6ba46ee tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:43.579547 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d94ba409-8570-4803-9ba9-6e8bd6ba46ee tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:43.580294 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d94ba409-8570-4803-9ba9-6e8bd6ba46ee tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:43.580741 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d94ba409-8570-4803-9ba9-6e8bd6ba46ee tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:43.581527 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d94ba409-8570-4803-9ba9-6e8bd6ba46ee tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:43.582003 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d94ba409-8570-4803-9ba9-6e8bd6ba46ee tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:43.582433 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d94ba409-8570-4803-9ba9-6e8bd6ba46ee tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:43.722199 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-d94ba409-8570-4803-9ba9-6e8bd6ba46ee tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:43.733255 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-d94ba409-8570-4803-9ba9-6e8bd6ba46ee tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:43.735312 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-d94ba409-8570-4803-9ba9-6e8bd6ba46ee tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:43.736480 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-d94ba409-8570-4803-9ba9-6e8bd6ba46ee tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1809 microversion: 2.20 time: 0.169778 Oct 03 14:56:43.737046 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 266/564] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:43 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:44.455652 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-23f6e5d7-5604-43e0-98c6-418802c2ef73 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:44.456367 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-23f6e5d7-5604-43e0-98c6-418802c2ef73 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:44.462956 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-23f6e5d7-5604-43e0-98c6-418802c2ef73 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:44.463444 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-23f6e5d7-5604-43e0-98c6-418802c2ef73 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:44.463874 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-23f6e5d7-5604-43e0-98c6-418802c2ef73 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:44.464564 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-23f6e5d7-5604-43e0-98c6-418802c2ef73 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:44.465016 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-23f6e5d7-5604-43e0-98c6-418802c2ef73 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:44.465436 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-23f6e5d7-5604-43e0-98c6-418802c2ef73 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:44.597309 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-23f6e5d7-5604-43e0-98c6-418802c2ef73 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:44.605668 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-23f6e5d7-5604-43e0-98c6-418802c2ef73 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1719 microversion: 2.1 time: 0.154405 Oct 03 14:56:44.606231 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 299/565] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:44 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:44.761717 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-11a2dd16-6630-4bbd-8e28-a6c73b38eec7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:44.762362 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-11a2dd16-6630-4bbd-8e28-a6c73b38eec7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:44.769547 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-11a2dd16-6630-4bbd-8e28-a6c73b38eec7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:44.770033 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-11a2dd16-6630-4bbd-8e28-a6c73b38eec7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:44.770470 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-11a2dd16-6630-4bbd-8e28-a6c73b38eec7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:44.771158 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-11a2dd16-6630-4bbd-8e28-a6c73b38eec7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:44.771608 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-11a2dd16-6630-4bbd-8e28-a6c73b38eec7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:44.772033 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-11a2dd16-6630-4bbd-8e28-a6c73b38eec7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:44.902317 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-11a2dd16-6630-4bbd-8e28-a6c73b38eec7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:44.910855 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-11a2dd16-6630-4bbd-8e28-a6c73b38eec7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:44.912317 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-11a2dd16-6630-4bbd-8e28-a6c73b38eec7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:44.913468 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-11a2dd16-6630-4bbd-8e28-a6c73b38eec7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1809 microversion: 2.20 time: 0.155721 Oct 03 14:56:44.914055 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 267/566] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:44 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:45.628495 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-9c30db92-2383-4b9e-bccf-17b7f092a0ce tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:45.629072 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-9c30db92-2383-4b9e-bccf-17b7f092a0ce tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:45.634927 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9c30db92-2383-4b9e-bccf-17b7f092a0ce tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:45.635403 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9c30db92-2383-4b9e-bccf-17b7f092a0ce tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:45.635830 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9c30db92-2383-4b9e-bccf-17b7f092a0ce tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:45.636505 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9c30db92-2383-4b9e-bccf-17b7f092a0ce tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:45.636952 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9c30db92-2383-4b9e-bccf-17b7f092a0ce tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:45.637369 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9c30db92-2383-4b9e-bccf-17b7f092a0ce tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:45.641627 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:56:45.763234 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-9c30db92-2383-4b9e-bccf-17b7f092a0ce tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:45.771621 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-9c30db92-2383-4b9e-bccf-17b7f092a0ce tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1719 microversion: 2.1 time: 0.147043 Oct 03 14:56:45.772181 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 300/567] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:45 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1719 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:45.939017 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-45a1d672-52d4-470a-a49a-b01389a53977 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:45.939632 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-45a1d672-52d4-470a-a49a-b01389a53977 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:45.945988 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-45a1d672-52d4-470a-a49a-b01389a53977 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:45.946482 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-45a1d672-52d4-470a-a49a-b01389a53977 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:45.946918 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-45a1d672-52d4-470a-a49a-b01389a53977 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:45.947607 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-45a1d672-52d4-470a-a49a-b01389a53977 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:45.948061 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-45a1d672-52d4-470a-a49a-b01389a53977 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:45.948489 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-45a1d672-52d4-470a-a49a-b01389a53977 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:46.073235 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-45a1d672-52d4-470a-a49a-b01389a53977 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:46.082370 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-45a1d672-52d4-470a-a49a-b01389a53977 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:46.083808 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-45a1d672-52d4-470a-a49a-b01389a53977 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:46.084968 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-45a1d672-52d4-470a-a49a-b01389a53977 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1809 microversion: 2.20 time: 0.149801 Oct 03 14:56:46.085551 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 268/568] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:45 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:46.795084 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-d6e0e455-49cb-4975-b2fa-648d6018c4ed tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:46.795691 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-d6e0e455-49cb-4975-b2fa-648d6018c4ed tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:46.801603 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d6e0e455-49cb-4975-b2fa-648d6018c4ed tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:46.802088 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d6e0e455-49cb-4975-b2fa-648d6018c4ed tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:46.802521 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d6e0e455-49cb-4975-b2fa-648d6018c4ed tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:46.803204 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d6e0e455-49cb-4975-b2fa-648d6018c4ed tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:46.803659 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d6e0e455-49cb-4975-b2fa-648d6018c4ed tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:46.804082 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d6e0e455-49cb-4975-b2fa-648d6018c4ed tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:46.941113 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-d6e0e455-49cb-4975-b2fa-648d6018c4ed tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:46.949264 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-d6e0e455-49cb-4975-b2fa-648d6018c4ed tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1719 microversion: 2.1 time: 0.158048 Oct 03 14:56:46.949859 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 301/569] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:46 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:47.111228 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-839e4c9f-c501-4c96-8fa7-ba2b5d51e354 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:47.111827 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-839e4c9f-c501-4c96-8fa7-ba2b5d51e354 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:47.118531 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-839e4c9f-c501-4c96-8fa7-ba2b5d51e354 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:47.118991 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-839e4c9f-c501-4c96-8fa7-ba2b5d51e354 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:47.119487 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-839e4c9f-c501-4c96-8fa7-ba2b5d51e354 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:47.120372 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-839e4c9f-c501-4c96-8fa7-ba2b5d51e354 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:47.120834 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-839e4c9f-c501-4c96-8fa7-ba2b5d51e354 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:47.121298 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-839e4c9f-c501-4c96-8fa7-ba2b5d51e354 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:47.256664 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-839e4c9f-c501-4c96-8fa7-ba2b5d51e354 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:47.265284 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-839e4c9f-c501-4c96-8fa7-ba2b5d51e354 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:47.266834 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-839e4c9f-c501-4c96-8fa7-ba2b5d51e354 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:47.267994 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-839e4c9f-c501-4c96-8fa7-ba2b5d51e354 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1809 microversion: 2.20 time: 0.161119 Oct 03 14:56:47.268552 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 269/570] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:47 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:47.974189 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-222cf73d-b1e8-467c-9151-3f8d242cc3f1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:47.974796 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-222cf73d-b1e8-467c-9151-3f8d242cc3f1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:47.980663 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-222cf73d-b1e8-467c-9151-3f8d242cc3f1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:47.981144 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-222cf73d-b1e8-467c-9151-3f8d242cc3f1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:47.981619 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-222cf73d-b1e8-467c-9151-3f8d242cc3f1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:47.982305 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-222cf73d-b1e8-467c-9151-3f8d242cc3f1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:47.982758 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-222cf73d-b1e8-467c-9151-3f8d242cc3f1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:47.983181 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-222cf73d-b1e8-467c-9151-3f8d242cc3f1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:48.109240 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-222cf73d-b1e8-467c-9151-3f8d242cc3f1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:48.117423 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-222cf73d-b1e8-467c-9151-3f8d242cc3f1 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1719 microversion: 2.1 time: 0.147087 Oct 03 14:56:48.118156 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 302/571] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:47 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1719 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:48.295618 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-aab48df9-b3c6-41de-9dc4-883071d1fc2e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:48.296644 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-aab48df9-b3c6-41de-9dc4-883071d1fc2e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:48.302766 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-aab48df9-b3c6-41de-9dc4-883071d1fc2e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:48.303248 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-aab48df9-b3c6-41de-9dc4-883071d1fc2e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:48.303677 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-aab48df9-b3c6-41de-9dc4-883071d1fc2e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:48.304417 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-aab48df9-b3c6-41de-9dc4-883071d1fc2e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:48.304869 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-aab48df9-b3c6-41de-9dc4-883071d1fc2e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:48.305315 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-aab48df9-b3c6-41de-9dc4-883071d1fc2e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:48.434427 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-aab48df9-b3c6-41de-9dc4-883071d1fc2e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:48.443498 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-aab48df9-b3c6-41de-9dc4-883071d1fc2e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:48.444935 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-aab48df9-b3c6-41de-9dc4-883071d1fc2e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:48.446115 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-aab48df9-b3c6-41de-9dc4-883071d1fc2e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1809 microversion: 2.20 time: 0.156308 Oct 03 14:56:48.446672 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 270/572] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:48 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:49.140766 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-682f8aa9-ed1f-4660-a4c2-374857a4b77e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:49.141372 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-682f8aa9-ed1f-4660-a4c2-374857a4b77e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:49.147292 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-682f8aa9-ed1f-4660-a4c2-374857a4b77e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:49.147773 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-682f8aa9-ed1f-4660-a4c2-374857a4b77e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:49.148209 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-682f8aa9-ed1f-4660-a4c2-374857a4b77e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:49.148895 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-682f8aa9-ed1f-4660-a4c2-374857a4b77e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:49.149352 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-682f8aa9-ed1f-4660-a4c2-374857a4b77e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:49.149803 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-682f8aa9-ed1f-4660-a4c2-374857a4b77e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:49.274025 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-682f8aa9-ed1f-4660-a4c2-374857a4b77e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:49.282711 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-682f8aa9-ed1f-4660-a4c2-374857a4b77e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1696 microversion: 2.1 time: 0.145757 Oct 03 14:56:49.283279 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 303/573] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:49 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1696 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:49.305383 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-5936b480-33e6-451b-a878-3b16ff475854 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:56:49.311806 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5936b480-33e6-451b-a878-3b16ff475854 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:49.312290 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5936b480-33e6-451b-a878-3b16ff475854 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:49.312723 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5936b480-33e6-451b-a878-3b16ff475854 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:49.334240 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-5936b480-33e6-451b-a878-3b16ff475854 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Going to try to start instance {{(pid=126852) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 03 14:56:49.375309 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-5936b480-33e6-451b-a878-3b16ff475854 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "POST /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc/action" status: 202 len: 0 microversion: 2.1 time: 0.073655 Oct 03 14:56:49.375896 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 271/574] 10.222.0.46 () {60 vars in 1278 bytes} [Mon Oct 3 14:56:49 2022] POST /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:56:49.383909 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-2433dc08-33e5-456c-a5bd-a8bf51eccead tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:49.384521 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-2433dc08-33e5-456c-a5bd-a8bf51eccead tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:49.390956 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2433dc08-33e5-456c-a5bd-a8bf51eccead tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:49.391379 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2433dc08-33e5-456c-a5bd-a8bf51eccead tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:49.391812 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2433dc08-33e5-456c-a5bd-a8bf51eccead tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:49.392511 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2433dc08-33e5-456c-a5bd-a8bf51eccead tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:49.392950 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2433dc08-33e5-456c-a5bd-a8bf51eccead tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:49.393377 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2433dc08-33e5-456c-a5bd-a8bf51eccead tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:49.477359 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-34c1d114-49ef-47e4-9f9a-e17d2b7b96f9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:49.478084 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-34c1d114-49ef-47e4-9f9a-e17d2b7b96f9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:49.484247 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-34c1d114-49ef-47e4-9f9a-e17d2b7b96f9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:49.484812 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-34c1d114-49ef-47e4-9f9a-e17d2b7b96f9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:49.485305 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-34c1d114-49ef-47e4-9f9a-e17d2b7b96f9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:49.486087 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-34c1d114-49ef-47e4-9f9a-e17d2b7b96f9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:49.486541 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-34c1d114-49ef-47e4-9f9a-e17d2b7b96f9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:49.486963 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-34c1d114-49ef-47e4-9f9a-e17d2b7b96f9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:49.522468 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-2433dc08-33e5-456c-a5bd-a8bf51eccead tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:49.531344 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-2433dc08-33e5-456c-a5bd-a8bf51eccead tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1705 microversion: 2.1 time: 0.150705 Oct 03 14:56:49.531903 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 304/575] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:49 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1705 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:49.661723 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-34c1d114-49ef-47e4-9f9a-e17d2b7b96f9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:49.670255 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-34c1d114-49ef-47e4-9f9a-e17d2b7b96f9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:49.671753 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-34c1d114-49ef-47e4-9f9a-e17d2b7b96f9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:49.672943 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-34c1d114-49ef-47e4-9f9a-e17d2b7b96f9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1809 microversion: 2.20 time: 0.199838 Oct 03 14:56:49.673526 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 272/576] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:49 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1809 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:50.554273 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-e02a3abd-8d5b-47a1-9835-9f120892cf48 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:50.554799 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-e02a3abd-8d5b-47a1-9835-9f120892cf48 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:50.560591 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e02a3abd-8d5b-47a1-9835-9f120892cf48 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:50.561069 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e02a3abd-8d5b-47a1-9835-9f120892cf48 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:50.561582 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e02a3abd-8d5b-47a1-9835-9f120892cf48 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:50.562263 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e02a3abd-8d5b-47a1-9835-9f120892cf48 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:50.562721 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e02a3abd-8d5b-47a1-9835-9f120892cf48 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:50.563140 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e02a3abd-8d5b-47a1-9835-9f120892cf48 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:50.698102 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-cb864737-c235-4bfd-9194-23b094ca551a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:50.698716 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-cb864737-c235-4bfd-9194-23b094ca551a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:50.704973 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cb864737-c235-4bfd-9194-23b094ca551a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:50.705455 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cb864737-c235-4bfd-9194-23b094ca551a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:50.705917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cb864737-c235-4bfd-9194-23b094ca551a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:50.706609 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cb864737-c235-4bfd-9194-23b094ca551a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:50.707063 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cb864737-c235-4bfd-9194-23b094ca551a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:50.707483 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cb864737-c235-4bfd-9194-23b094ca551a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:50.726408 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:56:50.738415 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-e02a3abd-8d5b-47a1-9835-9f120892cf48 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:50.746709 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-e02a3abd-8d5b-47a1-9835-9f120892cf48 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1705 microversion: 2.1 time: 0.196254 Oct 03 14:56:50.747285 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 305/577] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:50 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1705 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:50.842202 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-cb864737-c235-4bfd-9194-23b094ca551a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:50.851375 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-cb864737-c235-4bfd-9194-23b094ca551a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:50.853162 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-cb864737-c235-4bfd-9194-23b094ca551a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:50.854357 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-cb864737-c235-4bfd-9194-23b094ca551a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1809 microversion: 2.20 time: 0.160159 Oct 03 14:56:50.854923 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 273/578] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:50 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:56:51.769187 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-62470059-ced5-4d42-b705-daff381775d8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:51.769835 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-62470059-ced5-4d42-b705-daff381775d8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:51.775742 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-62470059-ced5-4d42-b705-daff381775d8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:51.776221 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-62470059-ced5-4d42-b705-daff381775d8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:51.776654 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-62470059-ced5-4d42-b705-daff381775d8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:51.777340 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-62470059-ced5-4d42-b705-daff381775d8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:51.777829 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-62470059-ced5-4d42-b705-daff381775d8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:51.778253 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-62470059-ced5-4d42-b705-daff381775d8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:51.880742 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-037c7f2c-8c87-48c5-b4b4-abc95ff6a119 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:51.881441 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-037c7f2c-8c87-48c5-b4b4-abc95ff6a119 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:51.887720 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-037c7f2c-8c87-48c5-b4b4-abc95ff6a119 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:51.888198 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-037c7f2c-8c87-48c5-b4b4-abc95ff6a119 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:51.888626 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-037c7f2c-8c87-48c5-b4b4-abc95ff6a119 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:51.889307 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-037c7f2c-8c87-48c5-b4b4-abc95ff6a119 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:51.889790 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-037c7f2c-8c87-48c5-b4b4-abc95ff6a119 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:51.890211 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-037c7f2c-8c87-48c5-b4b4-abc95ff6a119 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:51.910486 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-62470059-ced5-4d42-b705-daff381775d8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:51.918560 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-62470059-ced5-4d42-b705-daff381775d8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1705 microversion: 2.1 time: 0.153177 Oct 03 14:56:51.919118 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 306/579] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:51 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1705 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:52.016035 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-037c7f2c-8c87-48c5-b4b4-abc95ff6a119 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:52.024575 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-037c7f2c-8c87-48c5-b4b4-abc95ff6a119 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:52.025963 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-037c7f2c-8c87-48c5-b4b4-abc95ff6a119 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:52.027101 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-037c7f2c-8c87-48c5-b4b4-abc95ff6a119 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1809 microversion: 2.20 time: 0.150230 Oct 03 14:56:52.027651 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 274/580] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:51 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:56:52.942630 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-8696176f-b981-42b0-8d35-796284e7977b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:52.943243 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-8696176f-b981-42b0-8d35-796284e7977b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:52.949360 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8696176f-b981-42b0-8d35-796284e7977b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:52.949884 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8696176f-b981-42b0-8d35-796284e7977b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:52.950323 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8696176f-b981-42b0-8d35-796284e7977b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:52.951013 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8696176f-b981-42b0-8d35-796284e7977b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:52.951473 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8696176f-b981-42b0-8d35-796284e7977b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:52.951901 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8696176f-b981-42b0-8d35-796284e7977b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:53.052264 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-77604462-d20e-46ce-a259-bfa993e4b8d5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:53.052880 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-77604462-d20e-46ce-a259-bfa993e4b8d5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:53.059194 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-77604462-d20e-46ce-a259-bfa993e4b8d5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:53.059683 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-77604462-d20e-46ce-a259-bfa993e4b8d5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:53.060124 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-77604462-d20e-46ce-a259-bfa993e4b8d5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:53.060814 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-77604462-d20e-46ce-a259-bfa993e4b8d5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:53.061307 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-77604462-d20e-46ce-a259-bfa993e4b8d5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:53.061757 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-77604462-d20e-46ce-a259-bfa993e4b8d5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:53.077046 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-8696176f-b981-42b0-8d35-796284e7977b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:53.085752 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-8696176f-b981-42b0-8d35-796284e7977b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1709 microversion: 2.1 time: 0.146965 Oct 03 14:56:53.086317 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 307/581] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:52 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1709 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:53.198368 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-77604462-d20e-46ce-a259-bfa993e4b8d5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:53.206847 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-77604462-d20e-46ce-a259-bfa993e4b8d5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:53.208292 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-77604462-d20e-46ce-a259-bfa993e4b8d5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:53.209443 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-77604462-d20e-46ce-a259-bfa993e4b8d5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1809 microversion: 2.20 time: 0.161168 Oct 03 14:56:53.210036 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 275/582] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:53 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:54.235194 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-c1793548-9a31-46cb-8ff0-886334249d08 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:54.235818 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-c1793548-9a31-46cb-8ff0-886334249d08 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:54.241891 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c1793548-9a31-46cb-8ff0-886334249d08 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:54.242369 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c1793548-9a31-46cb-8ff0-886334249d08 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:54.242798 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c1793548-9a31-46cb-8ff0-886334249d08 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:54.243476 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c1793548-9a31-46cb-8ff0-886334249d08 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:54.243925 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c1793548-9a31-46cb-8ff0-886334249d08 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:54.244345 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c1793548-9a31-46cb-8ff0-886334249d08 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:54.372639 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-c1793548-9a31-46cb-8ff0-886334249d08 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:54.381887 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-c1793548-9a31-46cb-8ff0-886334249d08 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:54.383309 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-c1793548-9a31-46cb-8ff0-886334249d08 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:54.384449 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-c1793548-9a31-46cb-8ff0-886334249d08 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1809 microversion: 2.20 time: 0.153227 Oct 03 14:56:54.384999 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 308/583] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:54 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:55.410818 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-a3731748-28da-4b18-ae61-023b8f62c086 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:55.411422 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-a3731748-28da-4b18-ae61-023b8f62c086 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:55.417794 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a3731748-28da-4b18-ae61-023b8f62c086 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:55.418271 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a3731748-28da-4b18-ae61-023b8f62c086 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:55.418701 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a3731748-28da-4b18-ae61-023b8f62c086 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:55.419377 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a3731748-28da-4b18-ae61-023b8f62c086 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:55.419826 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a3731748-28da-4b18-ae61-023b8f62c086 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:55.420244 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a3731748-28da-4b18-ae61-023b8f62c086 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:55.547190 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-a3731748-28da-4b18-ae61-023b8f62c086 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:55.555652 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-a3731748-28da-4b18-ae61-023b8f62c086 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:55.557071 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-a3731748-28da-4b18-ae61-023b8f62c086 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:55.558242 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-a3731748-28da-4b18-ae61-023b8f62c086 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1809 microversion: 2.20 time: 0.151946 Oct 03 14:56:55.558796 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 276/584] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:55 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:56.583439 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-26979381-ef28-4f78-9f7f-a8865da5e467 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:56.584049 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-26979381-ef28-4f78-9f7f-a8865da5e467 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:56.590368 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-26979381-ef28-4f78-9f7f-a8865da5e467 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:56.590849 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-26979381-ef28-4f78-9f7f-a8865da5e467 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:56.591283 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-26979381-ef28-4f78-9f7f-a8865da5e467 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:56.591965 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-26979381-ef28-4f78-9f7f-a8865da5e467 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:56.592420 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-26979381-ef28-4f78-9f7f-a8865da5e467 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:56.592840 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-26979381-ef28-4f78-9f7f-a8865da5e467 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:56.717392 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-26979381-ef28-4f78-9f7f-a8865da5e467 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:56.726429 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-26979381-ef28-4f78-9f7f-a8865da5e467 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:56.727861 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-26979381-ef28-4f78-9f7f-a8865da5e467 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:56.729013 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-26979381-ef28-4f78-9f7f-a8865da5e467 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1809 microversion: 2.20 time: 0.149528 Oct 03 14:56:56.729586 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 309/585] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:56 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:57.755317 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-ea078fdf-c7f3-41c8-81ea-8d883307b2ca tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:57.755876 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-ea078fdf-c7f3-41c8-81ea-8d883307b2ca tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:57.762303 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ea078fdf-c7f3-41c8-81ea-8d883307b2ca tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:57.762783 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ea078fdf-c7f3-41c8-81ea-8d883307b2ca tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:57.763212 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ea078fdf-c7f3-41c8-81ea-8d883307b2ca tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:57.763889 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ea078fdf-c7f3-41c8-81ea-8d883307b2ca tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:57.764339 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ea078fdf-c7f3-41c8-81ea-8d883307b2ca tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:57.764754 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ea078fdf-c7f3-41c8-81ea-8d883307b2ca tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:57.894493 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-ea078fdf-c7f3-41c8-81ea-8d883307b2ca tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:57.903156 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-ea078fdf-c7f3-41c8-81ea-8d883307b2ca tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:57.904617 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-ea078fdf-c7f3-41c8-81ea-8d883307b2ca tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:57.905794 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-ea078fdf-c7f3-41c8-81ea-8d883307b2ca tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1809 microversion: 2.20 time: 0.154374 Oct 03 14:56:57.906409 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 277/586] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:57 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:58.932186 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-c393be83-85a1-479c-8465-fc0a76caa0c2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:58.932787 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-c393be83-85a1-479c-8465-fc0a76caa0c2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:58.939221 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c393be83-85a1-479c-8465-fc0a76caa0c2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:58.939701 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c393be83-85a1-479c-8465-fc0a76caa0c2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:58.940137 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c393be83-85a1-479c-8465-fc0a76caa0c2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:58.940827 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c393be83-85a1-479c-8465-fc0a76caa0c2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:58.941284 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c393be83-85a1-479c-8465-fc0a76caa0c2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:58.941746 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c393be83-85a1-479c-8465-fc0a76caa0c2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:59.065197 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-c393be83-85a1-479c-8465-fc0a76caa0c2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:59.073665 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-c393be83-85a1-479c-8465-fc0a76caa0c2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:59.075101 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-c393be83-85a1-479c-8465-fc0a76caa0c2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:59.076250 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-c393be83-85a1-479c-8465-fc0a76caa0c2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1809 microversion: 2.20 time: 0.147995 Oct 03 14:56:59.076809 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 310/587] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:58 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1809 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:59.515249 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-3d88900d-1f3b-4104-955a-6935e396a4bc req-55d72603-888f-4310-9f48-ed35502f3e33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27879d6c-62f5-4281-b134-faecf706a2db", "name": "network-vif-plugged", "status": "completed", "tag": "abd33b94-cd03-47ad-bbbe-b38838da0555"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:56:59.520758 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_api:SELECT=48 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:56:59.527633 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-3d88900d-1f3b-4104-955a-6935e396a4bc req-55d72603-888f-4310-9f48-ed35502f3e33 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:59.528120 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-3d88900d-1f3b-4104-955a-6935e396a4bc req-55d72603-888f-4310-9f48-ed35502f3e33 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:59.528552 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-3d88900d-1f3b-4104-955a-6935e396a4bc req-55d72603-888f-4310-9f48-ed35502f3e33 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:59.540366 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-3d88900d-1f3b-4104-955a-6935e396a4bc req-55d72603-888f-4310-9f48-ed35502f3e33 service nova] Creating event network-vif-plugged:abd33b94-cd03-47ad-bbbe-b38838da0555 for instance 27879d6c-62f5-4281-b134-faecf706a2db on hv-cinder-85987 Oct 03 14:56:59.545590 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-3d88900d-1f3b-4104-955a-6935e396a4bc req-55d72603-888f-4310-9f48-ed35502f3e33 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033737 Oct 03 14:56:59.546354 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 278/588] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:57:00.103431 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-fac4d224-b41f-4b8f-9500-72e4a383ea78 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:00.103978 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-fac4d224-b41f-4b8f-9500-72e4a383ea78 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:00.110006 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fac4d224-b41f-4b8f-9500-72e4a383ea78 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:00.110488 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fac4d224-b41f-4b8f-9500-72e4a383ea78 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:00.110922 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fac4d224-b41f-4b8f-9500-72e4a383ea78 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:00.111610 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fac4d224-b41f-4b8f-9500-72e4a383ea78 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:00.112065 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fac4d224-b41f-4b8f-9500-72e4a383ea78 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:00.112487 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fac4d224-b41f-4b8f-9500-72e4a383ea78 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:00.255220 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-fac4d224-b41f-4b8f-9500-72e4a383ea78 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:00.264074 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-fac4d224-b41f-4b8f-9500-72e4a383ea78 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:00.265560 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-fac4d224-b41f-4b8f-9500-72e4a383ea78 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:00.267335 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-fac4d224-b41f-4b8f-9500-72e4a383ea78 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1809 microversion: 2.20 time: 0.168507 Oct 03 14:57:00.267892 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 311/589] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:00 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:01.293241 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-a3de0250-7575-45d2-be35-085fdc536f24 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:01.293968 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-a3de0250-7575-45d2-be35-085fdc536f24 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:01.300862 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a3de0250-7575-45d2-be35-085fdc536f24 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:01.301299 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a3de0250-7575-45d2-be35-085fdc536f24 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:01.301766 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a3de0250-7575-45d2-be35-085fdc536f24 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:01.302466 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a3de0250-7575-45d2-be35-085fdc536f24 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:01.302924 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a3de0250-7575-45d2-be35-085fdc536f24 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:01.303361 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a3de0250-7575-45d2-be35-085fdc536f24 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:01.427472 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-a3de0250-7575-45d2-be35-085fdc536f24 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:01.435986 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-a3de0250-7575-45d2-be35-085fdc536f24 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:01.437435 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-a3de0250-7575-45d2-be35-085fdc536f24 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:01.438670 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-a3de0250-7575-45d2-be35-085fdc536f24 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1809 microversion: 2.20 time: 0.150221 Oct 03 14:57:01.439247 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 279/590] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:01 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:02.464932 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-b1caf4db-cb7b-4dbe-be33-af612b8a3dd9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:02.465665 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-b1caf4db-cb7b-4dbe-be33-af612b8a3dd9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:02.467551 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_api:SELECT=48 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:57:02.473825 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b1caf4db-cb7b-4dbe-be33-af612b8a3dd9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:02.474191 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b1caf4db-cb7b-4dbe-be33-af612b8a3dd9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:02.474630 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b1caf4db-cb7b-4dbe-be33-af612b8a3dd9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:02.475335 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b1caf4db-cb7b-4dbe-be33-af612b8a3dd9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:02.475797 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b1caf4db-cb7b-4dbe-be33-af612b8a3dd9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:02.476225 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b1caf4db-cb7b-4dbe-be33-af612b8a3dd9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:02.607828 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-b1caf4db-cb7b-4dbe-be33-af612b8a3dd9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:02.617575 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-b1caf4db-cb7b-4dbe-be33-af612b8a3dd9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:02.620106 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-b1caf4db-cb7b-4dbe-be33-af612b8a3dd9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:02.621284 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-b1caf4db-cb7b-4dbe-be33-af612b8a3dd9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1809 microversion: 2.20 time: 0.160876 Oct 03 14:57:02.622064 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 312/591] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:02 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:03.646568 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-66fa01a2-98d3-420a-a4ea-c6e1e8310b5e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:03.647118 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-66fa01a2-98d3-420a-a4ea-c6e1e8310b5e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:03.653108 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-66fa01a2-98d3-420a-a4ea-c6e1e8310b5e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:03.653621 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-66fa01a2-98d3-420a-a4ea-c6e1e8310b5e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:03.654058 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-66fa01a2-98d3-420a-a4ea-c6e1e8310b5e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:03.654739 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-66fa01a2-98d3-420a-a4ea-c6e1e8310b5e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:03.655202 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-66fa01a2-98d3-420a-a4ea-c6e1e8310b5e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:03.655623 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-66fa01a2-98d3-420a-a4ea-c6e1e8310b5e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:03.787018 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-66fa01a2-98d3-420a-a4ea-c6e1e8310b5e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:03.795539 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-66fa01a2-98d3-420a-a4ea-c6e1e8310b5e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:03.796974 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-66fa01a2-98d3-420a-a4ea-c6e1e8310b5e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:03.798645 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-66fa01a2-98d3-420a-a4ea-c6e1e8310b5e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1796 microversion: 2.20 time: 0.156269 Oct 03 14:57:03.799202 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 280/592] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:03 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1796 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:09.683650 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-c3a65f6a-50eb-4378-b97a-92c549e49d80 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50da1ed0-3553-4217-99ce-4fc762f03f90"}} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:57:09.686070 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-c3a65f6a-50eb-4378-b97a-92c549e49d80 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:09.691986 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c3a65f6a-50eb-4378-b97a-92c549e49d80 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:09.692464 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c3a65f6a-50eb-4378-b97a-92c549e49d80 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:09.692897 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c3a65f6a-50eb-4378-b97a-92c549e49d80 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:09.693677 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c3a65f6a-50eb-4378-b97a-92c549e49d80 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:09.694135 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c3a65f6a-50eb-4378-b97a-92c549e49d80 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:09.694560 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c3a65f6a-50eb-4378-b97a-92c549e49d80 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:09.991318 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-c3a65f6a-50eb-4378-b97a-92c549e49d80 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "POST /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.410922 Oct 03 14:57:09.991932 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 313/593] 10.222.0.46 () {60 vars in 1323 bytes} [Mon Oct 3 14:57:09 2022] POST /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f/os-volume_attachments => generated 194 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:57:17.669303 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-58666ca5-7332-4b25-925c-248bbe8b25c8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:57:17.672289 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-58666ca5-7332-4b25-925c-248bbe8b25c8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:17.675472 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_api:SELECT=5 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:57:17.676232 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=40 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:57:17.682551 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-58666ca5-7332-4b25-925c-248bbe8b25c8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:17.683039 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-58666ca5-7332-4b25-925c-248bbe8b25c8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:17.683479 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-58666ca5-7332-4b25-925c-248bbe8b25c8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:17.684182 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-58666ca5-7332-4b25-925c-248bbe8b25c8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:17.684643 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-58666ca5-7332-4b25-925c-248bbe8b25c8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:17.685073 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-58666ca5-7332-4b25-925c-248bbe8b25c8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:17.707559 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.objects.instance [None req-58666ca5-7332-4b25-925c-248bbe8b25c8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lazy-loading 'flavor' on Instance uuid 3a42b833-728b-44e8-af21-fe86e25c035f {{(pid=126852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:57:17.870566 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-58666ca5-7332-4b25-925c-248bbe8b25c8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "POST /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f/action" status: 200 len: 32 microversion: 2.1 time: 0.205064 Oct 03 14:57:17.871162 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 281/594] 10.222.0.46 () {60 vars in 1278 bytes} [Mon Oct 3 14:57:17 2022] POST /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f/action => generated 32 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:57:17.881949 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-6b18ec18-3b0f-4200-b634-55a688230902 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:17.882679 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-6b18ec18-3b0f-4200-b634-55a688230902 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:17.891904 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6b18ec18-3b0f-4200-b634-55a688230902 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:17.892567 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6b18ec18-3b0f-4200-b634-55a688230902 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:17.893017 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6b18ec18-3b0f-4200-b634-55a688230902 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:17.893749 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6b18ec18-3b0f-4200-b634-55a688230902 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:17.894212 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6b18ec18-3b0f-4200-b634-55a688230902 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:17.894639 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6b18ec18-3b0f-4200-b634-55a688230902 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:17.898781 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:57:18.032966 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-6b18ec18-3b0f-4200-b634-55a688230902 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:18.041344 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-6b18ec18-3b0f-4200-b634-55a688230902 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1735 microversion: 2.1 time: 0.164169 Oct 03 14:57:18.041962 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 314/595] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:17 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:19.065279 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-f1a5b0a1-77bf-45e2-9b79-de3fc3ff78a3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:19.066006 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-f1a5b0a1-77bf-45e2-9b79-de3fc3ff78a3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:19.072664 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f1a5b0a1-77bf-45e2-9b79-de3fc3ff78a3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:19.073146 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f1a5b0a1-77bf-45e2-9b79-de3fc3ff78a3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:19.073615 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f1a5b0a1-77bf-45e2-9b79-de3fc3ff78a3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:19.074304 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f1a5b0a1-77bf-45e2-9b79-de3fc3ff78a3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:19.074753 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f1a5b0a1-77bf-45e2-9b79-de3fc3ff78a3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:19.075175 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f1a5b0a1-77bf-45e2-9b79-de3fc3ff78a3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:19.200191 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-f1a5b0a1-77bf-45e2-9b79-de3fc3ff78a3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:19.208389 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-f1a5b0a1-77bf-45e2-9b79-de3fc3ff78a3 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1735 microversion: 2.1 time: 0.147907 Oct 03 14:57:19.208956 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 282/596] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:19 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:20.231399 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-f5873452-c63f-4745-bd87-86012bfc6e83 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:20.232014 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-f5873452-c63f-4745-bd87-86012bfc6e83 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:20.239042 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f5873452-c63f-4745-bd87-86012bfc6e83 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:20.239533 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f5873452-c63f-4745-bd87-86012bfc6e83 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:20.239970 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f5873452-c63f-4745-bd87-86012bfc6e83 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:20.240706 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f5873452-c63f-4745-bd87-86012bfc6e83 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:20.241167 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f5873452-c63f-4745-bd87-86012bfc6e83 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:20.241627 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f5873452-c63f-4745-bd87-86012bfc6e83 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:20.369342 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-f5873452-c63f-4745-bd87-86012bfc6e83 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:20.378235 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-f5873452-c63f-4745-bd87-86012bfc6e83 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1735 microversion: 2.1 time: 0.150723 Oct 03 14:57:20.378797 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 315/597] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:20 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:21.401071 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-f35b0b1a-d43d-42c3-874a-97d1f7bf42c6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:21.401704 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-f35b0b1a-d43d-42c3-874a-97d1f7bf42c6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:21.408090 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f35b0b1a-d43d-42c3-874a-97d1f7bf42c6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:21.408567 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f35b0b1a-d43d-42c3-874a-97d1f7bf42c6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:21.408997 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f35b0b1a-d43d-42c3-874a-97d1f7bf42c6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:21.409696 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f35b0b1a-d43d-42c3-874a-97d1f7bf42c6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:21.410150 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f35b0b1a-d43d-42c3-874a-97d1f7bf42c6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:21.410566 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f35b0b1a-d43d-42c3-874a-97d1f7bf42c6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:21.541556 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-f35b0b1a-d43d-42c3-874a-97d1f7bf42c6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:21.549642 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-f35b0b1a-d43d-42c3-874a-97d1f7bf42c6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1735 microversion: 2.1 time: 0.152379 Oct 03 14:57:21.550134 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 283/598] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:21 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:22.572381 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-9de1f7e7-ba75-479c-8ad0-c055a0a89195 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:22.572915 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-9de1f7e7-ba75-479c-8ad0-c055a0a89195 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:22.579904 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9de1f7e7-ba75-479c-8ad0-c055a0a89195 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:22.580401 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9de1f7e7-ba75-479c-8ad0-c055a0a89195 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:22.580837 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9de1f7e7-ba75-479c-8ad0-c055a0a89195 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:22.581562 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9de1f7e7-ba75-479c-8ad0-c055a0a89195 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:22.582021 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9de1f7e7-ba75-479c-8ad0-c055a0a89195 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:22.582450 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9de1f7e7-ba75-479c-8ad0-c055a0a89195 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:22.708151 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-9de1f7e7-ba75-479c-8ad0-c055a0a89195 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:22.716467 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-9de1f7e7-ba75-479c-8ad0-c055a0a89195 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1735 microversion: 2.1 time: 0.148031 Oct 03 14:57:22.717030 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 316/599] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:22 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:23.739988 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-fb2e38ab-1f24-4c49-b53a-01c934600369 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:23.740617 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-fb2e38ab-1f24-4c49-b53a-01c934600369 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:23.747948 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fb2e38ab-1f24-4c49-b53a-01c934600369 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:23.748456 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fb2e38ab-1f24-4c49-b53a-01c934600369 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:23.748899 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fb2e38ab-1f24-4c49-b53a-01c934600369 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:23.749673 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fb2e38ab-1f24-4c49-b53a-01c934600369 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:23.750142 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fb2e38ab-1f24-4c49-b53a-01c934600369 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:23.750573 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fb2e38ab-1f24-4c49-b53a-01c934600369 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:23.881156 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-fb2e38ab-1f24-4c49-b53a-01c934600369 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:23.889419 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-fb2e38ab-1f24-4c49-b53a-01c934600369 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1735 microversion: 2.1 time: 0.153297 Oct 03 14:57:23.890507 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 284/600] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:23 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:24.913643 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-62eb6b90-eaa1-4659-b5e5-1722879af44a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:24.914290 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-62eb6b90-eaa1-4659-b5e5-1722879af44a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:24.920619 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-62eb6b90-eaa1-4659-b5e5-1722879af44a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:24.921097 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-62eb6b90-eaa1-4659-b5e5-1722879af44a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:24.921574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-62eb6b90-eaa1-4659-b5e5-1722879af44a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:24.922756 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-62eb6b90-eaa1-4659-b5e5-1722879af44a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:24.923207 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-62eb6b90-eaa1-4659-b5e5-1722879af44a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:24.923625 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-62eb6b90-eaa1-4659-b5e5-1722879af44a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:25.050822 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-62eb6b90-eaa1-4659-b5e5-1722879af44a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:25.058809 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-62eb6b90-eaa1-4659-b5e5-1722879af44a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1735 microversion: 2.1 time: 0.149022 Oct 03 14:57:25.059373 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 317/601] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:24 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:26.081398 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-9dee8e7b-ab1b-41b7-8069-523b431694fb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:26.082023 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-9dee8e7b-ab1b-41b7-8069-523b431694fb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:26.088563 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9dee8e7b-ab1b-41b7-8069-523b431694fb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:26.089042 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9dee8e7b-ab1b-41b7-8069-523b431694fb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:26.089472 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9dee8e7b-ab1b-41b7-8069-523b431694fb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:26.090182 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9dee8e7b-ab1b-41b7-8069-523b431694fb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:26.090635 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9dee8e7b-ab1b-41b7-8069-523b431694fb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:26.091059 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9dee8e7b-ab1b-41b7-8069-523b431694fb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:26.217170 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-9dee8e7b-ab1b-41b7-8069-523b431694fb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:26.225261 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-9dee8e7b-ab1b-41b7-8069-523b431694fb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1735 microversion: 2.1 time: 0.147721 Oct 03 14:57:26.225864 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 285/602] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:26 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:27.248156 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-a85064db-52f3-4c9d-acf2-c9f858f45425 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:27.248830 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-a85064db-52f3-4c9d-acf2-c9f858f45425 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:27.255901 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a85064db-52f3-4c9d-acf2-c9f858f45425 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:27.256383 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a85064db-52f3-4c9d-acf2-c9f858f45425 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:27.256817 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a85064db-52f3-4c9d-acf2-c9f858f45425 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:27.257530 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a85064db-52f3-4c9d-acf2-c9f858f45425 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:27.257988 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a85064db-52f3-4c9d-acf2-c9f858f45425 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:27.258408 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a85064db-52f3-4c9d-acf2-c9f858f45425 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:27.386515 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-a85064db-52f3-4c9d-acf2-c9f858f45425 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:27.395179 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-a85064db-52f3-4c9d-acf2-c9f858f45425 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1735 microversion: 2.1 time: 0.150876 Oct 03 14:57:27.395738 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 318/603] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:27 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:28.418494 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-fbba7887-5892-4d9a-b32e-66aab8a5924b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:28.419106 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-fbba7887-5892-4d9a-b32e-66aab8a5924b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:28.425574 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fbba7887-5892-4d9a-b32e-66aab8a5924b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:28.426057 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fbba7887-5892-4d9a-b32e-66aab8a5924b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:28.426491 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fbba7887-5892-4d9a-b32e-66aab8a5924b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:28.427175 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fbba7887-5892-4d9a-b32e-66aab8a5924b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:28.427630 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fbba7887-5892-4d9a-b32e-66aab8a5924b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:28.428048 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fbba7887-5892-4d9a-b32e-66aab8a5924b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:28.553140 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-fbba7887-5892-4d9a-b32e-66aab8a5924b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:28.561233 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-fbba7887-5892-4d9a-b32e-66aab8a5924b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1735 microversion: 2.1 time: 0.146621 Oct 03 14:57:28.561826 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 286/604] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:28 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:29.584427 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-d4919044-43cf-4f5a-858a-93e31a0e225c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:29.584974 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-d4919044-43cf-4f5a-858a-93e31a0e225c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:29.591561 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d4919044-43cf-4f5a-858a-93e31a0e225c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:29.592046 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d4919044-43cf-4f5a-858a-93e31a0e225c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:29.592479 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d4919044-43cf-4f5a-858a-93e31a0e225c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:29.593162 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d4919044-43cf-4f5a-858a-93e31a0e225c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:29.594140 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d4919044-43cf-4f5a-858a-93e31a0e225c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:29.594560 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d4919044-43cf-4f5a-858a-93e31a0e225c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:29.723837 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-d4919044-43cf-4f5a-858a-93e31a0e225c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:29.731951 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-d4919044-43cf-4f5a-858a-93e31a0e225c tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1735 microversion: 2.1 time: 0.151631 Oct 03 14:57:29.732514 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 319/605] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:29 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:30.756260 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-38dd9440-041b-42b0-89ed-35068dee7b4d tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:30.756868 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-38dd9440-041b-42b0-89ed-35068dee7b4d tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:30.763445 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-38dd9440-041b-42b0-89ed-35068dee7b4d tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:30.763924 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-38dd9440-041b-42b0-89ed-35068dee7b4d tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:30.764353 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-38dd9440-041b-42b0-89ed-35068dee7b4d tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:30.765032 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-38dd9440-041b-42b0-89ed-35068dee7b4d tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:30.765485 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-38dd9440-041b-42b0-89ed-35068dee7b4d tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:30.765927 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-38dd9440-041b-42b0-89ed-35068dee7b4d tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:30.888893 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-38dd9440-041b-42b0-89ed-35068dee7b4d tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:30.896990 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-38dd9440-041b-42b0-89ed-35068dee7b4d tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1735 microversion: 2.1 time: 0.144531 Oct 03 14:57:30.897567 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 287/606] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:30 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:31.921063 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-8e6faa6f-a20b-48fd-b6c0-9d2150388bcb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:31.921783 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-8e6faa6f-a20b-48fd-b6c0-9d2150388bcb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:31.927872 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8e6faa6f-a20b-48fd-b6c0-9d2150388bcb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:31.928345 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8e6faa6f-a20b-48fd-b6c0-9d2150388bcb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:31.928806 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8e6faa6f-a20b-48fd-b6c0-9d2150388bcb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:31.929487 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8e6faa6f-a20b-48fd-b6c0-9d2150388bcb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:31.929965 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8e6faa6f-a20b-48fd-b6c0-9d2150388bcb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:31.930382 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8e6faa6f-a20b-48fd-b6c0-9d2150388bcb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:32.055375 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-8e6faa6f-a20b-48fd-b6c0-9d2150388bcb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:32.064037 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-8e6faa6f-a20b-48fd-b6c0-9d2150388bcb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1735 microversion: 2.1 time: 0.147568 Oct 03 14:57:32.064595 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 320/607] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:31 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:33.087916 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-0d5401f6-33cb-41a2-a832-d0b0f8e1809e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:33.088577 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-0d5401f6-33cb-41a2-a832-d0b0f8e1809e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:33.094730 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0d5401f6-33cb-41a2-a832-d0b0f8e1809e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:33.095217 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0d5401f6-33cb-41a2-a832-d0b0f8e1809e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:33.095654 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0d5401f6-33cb-41a2-a832-d0b0f8e1809e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:33.096386 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0d5401f6-33cb-41a2-a832-d0b0f8e1809e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:33.096792 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0d5401f6-33cb-41a2-a832-d0b0f8e1809e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:33.097215 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0d5401f6-33cb-41a2-a832-d0b0f8e1809e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:33.222192 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-0d5401f6-33cb-41a2-a832-d0b0f8e1809e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:33.230407 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-0d5401f6-33cb-41a2-a832-d0b0f8e1809e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1715 microversion: 2.1 time: 0.146710 Oct 03 14:57:33.230971 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 288/608] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:33 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1715 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:33.292080 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-c03fb763-f1d7-44f1-bdb8-581c37cae091 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:33.292656 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-c03fb763-f1d7-44f1-bdb8-581c37cae091 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:33.295160 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_api:SELECT=18 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:57:33.301686 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c03fb763-f1d7-44f1-bdb8-581c37cae091 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:33.302178 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c03fb763-f1d7-44f1-bdb8-581c37cae091 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:33.302617 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c03fb763-f1d7-44f1-bdb8-581c37cae091 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:33.303319 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c03fb763-f1d7-44f1-bdb8-581c37cae091 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:33.303774 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c03fb763-f1d7-44f1-bdb8-581c37cae091 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:33.304200 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c03fb763-f1d7-44f1-bdb8-581c37cae091 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:33.426822 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.wsgi [None req-c03fb763-f1d7-44f1-bdb8-581c37cae091 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] HTTP exception thrown: Cannot 'detach_volume' instance 3a42b833-728b-44e8-af21-fe86e25c035f while it is in vm_state rescued Oct 03 14:57:33.428413 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-c03fb763-f1d7-44f1-bdb8-581c37cae091 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Request method failure captured: Oct 03 14:57:33.428413 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: request: DELETE /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f/os-volume_attachments/50da1ed0-3553-4217-99ce-4fc762f03f90 HTTP/1.1 Oct 03 14:57:33.428413 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept: application/json Oct 03 14:57:33.428413 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept-Encoding: identity Oct 03 14:57:33.428413 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Connection: close Oct 03 14:57:33.428413 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Length: 0 Oct 03 14:57:33.428413 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Type: application/json Oct 03 14:57:33.428413 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Host: 10.222.0.46 Oct 03 14:57:33.428413 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Openstack-System-Scope: None Oct 03 14:57:33.428413 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: User-Agent: python-urllib3/1.26.12 Oct 03 14:57:33.428413 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Auth-Token: gAAAAABjOvcVbKiHnNy90WglqYe5Q1MwexWf6mCQgnW_RoYIDHCKZyjYComPW_WJfpkmYdPGmBh_lHytVTlk3gOxTumrJiqzfNInV4R1Rg-YBW8I7tzJMuPKobbPL6KZa8sK-WadPvCsNgL3ob2ccjWgfOhEn-3_ZHmMK9Tu9uRhH_3sf5LyZ5o Oct 03 14:57:33.428413 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Id: None Oct 03 14:57:33.428413 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Name: None Oct 03 14:57:33.428413 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Identity-Status: Confirmed Oct 03 14:57:33.428413 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Is-Admin-Project: True Oct 03 14:57:33.428413 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Id: default Oct 03 14:57:33.428413 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Name: Default Oct 03 14:57:33.428413 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Id: 83b495f3cb9b437d9572f4d33327fbf7 Oct 03 14:57:33.428413 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-685876426 Oct 03 14:57:33.428413 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Role: member,reader Oct 03 14:57:33.428413 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Roles: member,reader Oct 03 14:57:33.430087 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/83b495f3cb9b437d9572f4d33327fbf7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_83b495f3cb9b437d9572f4d33327fbf7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/83b495f3cb9b437d9572f4d33327fbf7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/83b495f3cb9b437d9572f4d33327fbf7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 14:57:33.430087 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant: tempest-ServerRescueNegativeTestJSON-685876426 Oct 03 14:57:33.430087 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Id: 83b495f3cb9b437d9572f4d33327fbf7 Oct 03 14:57:33.430087 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-685876426 Oct 03 14:57:33.430087 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User: tempest-ServerRescueNegativeTestJSON-685876426-project Oct 03 14:57:33.430087 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Id: default Oct 03 14:57:33.430087 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Name: Default Oct 03 14:57:33.430087 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Id: 335dd8706d4c402e98605479b57d059a Oct 03 14:57:33.430087 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Name: tempest-ServerRescueNegativeTestJSON-685876426-project Oct 03 14:57:33.430087 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: method: > Oct 03 14:57:33.430087 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: exception: Cannot 'detach_volume' instance 3a42b833-728b-44e8-af21-fe86e25c035f while it is in vm_state rescued Oct 03 14:57:33.433926 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: action_args: {'server_id': '3a42b833-728b-44e8-af21-fe86e25c035f', 'id': '50da1ed0-3553-4217-99ce-4fc762f03f90'} Oct 03 14:57:33.433926 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:57:33.433926 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:33.433926 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 03 14:57:33.433926 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 03 14:57:33.433926 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 14:57:33.433926 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 14:57:33.433926 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 03 14:57:33.433926 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 03 14:57:33.433926 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3a42b833-728b-44e8-af21-fe86e25c035f in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 03 14:57:33.433926 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:57:33.433926 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:33.433926 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:57:33.433926 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:33.433926 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:33.433926 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:33.433926 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:57:33.433926 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:57:33.433926 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:57:33.433926 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:57:33.435378 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 03 14:57:33.435378 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 03 14:57:33.435378 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 03 14:57:33.435378 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 14:57:33.435378 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 3a42b833-728b-44e8-af21-fe86e25c035f while it is in vm_state rescued Oct 03 14:57:33.435378 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:57:33.435378 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:33.435378 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:57:33.435378 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:33.435378 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:33.435378 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:33.435378 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:57:33.435378 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:57:33.435378 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 3a42b833-728b-44e8-af21-fe86e25c035f while it is in vm_state rescued Oct 03 14:57:33.435378 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:57:33.435378 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-c03fb763-f1d7-44f1-bdb8-581c37cae091 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Returning 409 to user: Cannot 'detach_volume' instance 3a42b833-728b-44e8-af21-fe86e25c035f while it is in vm_state rescued {{(pid=126851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:57:33.436546 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-c03fb763-f1d7-44f1-bdb8-581c37cae091 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f/os-volume_attachments/50da1ed0-3553-4217-99ce-4fc762f03f90" status: 409 len: 152 microversion: 2.1 time: 0.141799 Oct 03 14:57:33.436546 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 321/609] 10.222.0.46 () {58 vars in 1416 bytes} [Mon Oct 3 14:57:33 2022] DELETE /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f/os-volume_attachments/50da1ed0-3553-4217-99ce-4fc762f03f90 => generated 152 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:57:33.438776 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-63a0d961-bc45-4eae-bb92-4d6d35aa76f8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:57:33.439316 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-63a0d961-bc45-4eae-bb92-4d6d35aa76f8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:33.445269 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-63a0d961-bc45-4eae-bb92-4d6d35aa76f8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:33.445773 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-63a0d961-bc45-4eae-bb92-4d6d35aa76f8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:33.446205 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-63a0d961-bc45-4eae-bb92-4d6d35aa76f8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:33.446886 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-63a0d961-bc45-4eae-bb92-4d6d35aa76f8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:33.447335 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-63a0d961-bc45-4eae-bb92-4d6d35aa76f8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:33.447753 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-63a0d961-bc45-4eae-bb92-4d6d35aa76f8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:33.518440 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-63a0d961-bc45-4eae-bb92-4d6d35aa76f8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "POST /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f/action" status: 202 len: 0 microversion: 2.1 time: 0.083258 Oct 03 14:57:33.519085 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 289/610] 10.222.0.46 () {60 vars in 1278 bytes} [Mon Oct 3 14:57:33 2022] POST /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:57:33.527143 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-0b9e7ee9-8fd3-4d90-a278-63a26884c045 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:33.527771 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-0b9e7ee9-8fd3-4d90-a278-63a26884c045 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:33.535210 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0b9e7ee9-8fd3-4d90-a278-63a26884c045 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:33.535712 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0b9e7ee9-8fd3-4d90-a278-63a26884c045 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:33.536131 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0b9e7ee9-8fd3-4d90-a278-63a26884c045 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:33.536830 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0b9e7ee9-8fd3-4d90-a278-63a26884c045 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:33.537287 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0b9e7ee9-8fd3-4d90-a278-63a26884c045 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:33.537743 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0b9e7ee9-8fd3-4d90-a278-63a26884c045 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:33.669008 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-0b9e7ee9-8fd3-4d90-a278-63a26884c045 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:33.677368 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-0b9e7ee9-8fd3-4d90-a278-63a26884c045 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1723 microversion: 2.1 time: 0.154001 Oct 03 14:57:33.678026 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 322/611] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:33 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:34.701157 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-33e9d77c-b338-4ff9-b374-6e92e7ac7bb7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:34.701879 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-33e9d77c-b338-4ff9-b374-6e92e7ac7bb7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:34.707926 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-33e9d77c-b338-4ff9-b374-6e92e7ac7bb7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:34.708435 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-33e9d77c-b338-4ff9-b374-6e92e7ac7bb7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:34.708883 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-33e9d77c-b338-4ff9-b374-6e92e7ac7bb7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:34.709625 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-33e9d77c-b338-4ff9-b374-6e92e7ac7bb7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:34.710084 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-33e9d77c-b338-4ff9-b374-6e92e7ac7bb7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:34.710512 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-33e9d77c-b338-4ff9-b374-6e92e7ac7bb7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:35.051327 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-33e9d77c-b338-4ff9-b374-6e92e7ac7bb7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:35.059515 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-33e9d77c-b338-4ff9-b374-6e92e7ac7bb7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1723 microversion: 2.1 time: 0.363029 Oct 03 14:57:35.060084 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 290/612] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:34 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1723 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:36.082602 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-a765e774-8c0b-4f9f-b866-3ab06cb049da tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:36.083234 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-a765e774-8c0b-4f9f-b866-3ab06cb049da tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:36.089861 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a765e774-8c0b-4f9f-b866-3ab06cb049da tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:36.090353 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a765e774-8c0b-4f9f-b866-3ab06cb049da tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:36.090779 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a765e774-8c0b-4f9f-b866-3ab06cb049da tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:36.091452 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a765e774-8c0b-4f9f-b866-3ab06cb049da tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:36.091906 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a765e774-8c0b-4f9f-b866-3ab06cb049da tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:36.092323 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a765e774-8c0b-4f9f-b866-3ab06cb049da tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:36.216069 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-a765e774-8c0b-4f9f-b866-3ab06cb049da tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:36.224547 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-a765e774-8c0b-4f9f-b866-3ab06cb049da tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1723 microversion: 2.1 time: 0.145814 Oct 03 14:57:36.225102 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 323/613] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:36 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:37.248234 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-27207207-5fbb-46bb-a67b-98e71a4e4c22 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:37.248838 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-27207207-5fbb-46bb-a67b-98e71a4e4c22 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:37.255139 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-27207207-5fbb-46bb-a67b-98e71a4e4c22 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:37.255619 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-27207207-5fbb-46bb-a67b-98e71a4e4c22 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:37.256071 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-27207207-5fbb-46bb-a67b-98e71a4e4c22 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:37.256757 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-27207207-5fbb-46bb-a67b-98e71a4e4c22 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:37.257210 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-27207207-5fbb-46bb-a67b-98e71a4e4c22 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:37.257659 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-27207207-5fbb-46bb-a67b-98e71a4e4c22 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:37.386650 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-27207207-5fbb-46bb-a67b-98e71a4e4c22 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:37.395240 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-27207207-5fbb-46bb-a67b-98e71a4e4c22 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1723 microversion: 2.1 time: 0.150855 Oct 03 14:57:37.395811 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 291/614] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:37 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:38.418841 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-4eef9a5c-990c-4492-a331-d64853ed0b1b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:38.419448 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-4eef9a5c-990c-4492-a331-d64853ed0b1b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:38.426358 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4eef9a5c-990c-4492-a331-d64853ed0b1b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:38.426840 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4eef9a5c-990c-4492-a331-d64853ed0b1b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:38.427274 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4eef9a5c-990c-4492-a331-d64853ed0b1b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:38.427950 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4eef9a5c-990c-4492-a331-d64853ed0b1b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:38.428411 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4eef9a5c-990c-4492-a331-d64853ed0b1b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:38.428830 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4eef9a5c-990c-4492-a331-d64853ed0b1b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:38.559538 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-4eef9a5c-990c-4492-a331-d64853ed0b1b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:38.567658 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-4eef9a5c-990c-4492-a331-d64853ed0b1b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1729 microversion: 2.1 time: 0.152653 Oct 03 14:57:38.568214 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 324/615] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:38 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:38.590265 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-ebd1bd4f-3303-458c-8944-44f83ce6dacc tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:38.590780 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-ebd1bd4f-3303-458c-8944-44f83ce6dacc tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:38.597689 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ebd1bd4f-3303-458c-8944-44f83ce6dacc tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:38.598174 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ebd1bd4f-3303-458c-8944-44f83ce6dacc tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:38.598609 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ebd1bd4f-3303-458c-8944-44f83ce6dacc tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:38.599297 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ebd1bd4f-3303-458c-8944-44f83ce6dacc tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:38.599753 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ebd1bd4f-3303-458c-8944-44f83ce6dacc tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:38.600174 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ebd1bd4f-3303-458c-8944-44f83ce6dacc tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:38.677564 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-ebd1bd4f-3303-458c-8944-44f83ce6dacc tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091025 Oct 03 14:57:38.678224 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 292/616] 10.222.0.46 () {58 vars in 1275 bytes} [Mon Oct 3 14:57:38 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:57:39.610749 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-f934184d-e0b1-466e-a360-a7c80a1609dd req-86f9339d-a238-4779-a514-7e626bee51d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a42b833-728b-44e8-af21-fe86e25c035f", "tag": "71f04a2e-59ac-4427-96fb-90ece95bcbde"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:57:39.623050 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-f934184d-e0b1-466e-a360-a7c80a1609dd req-86f9339d-a238-4779-a514-7e626bee51d1 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:39.623529 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-f934184d-e0b1-466e-a360-a7c80a1609dd req-86f9339d-a238-4779-a514-7e626bee51d1 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:39.623955 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-f934184d-e0b1-466e-a360-a7c80a1609dd req-86f9339d-a238-4779-a514-7e626bee51d1 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:39.634670 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-f934184d-e0b1-466e-a360-a7c80a1609dd req-86f9339d-a238-4779-a514-7e626bee51d1 service nova] Creating event network-changed:71f04a2e-59ac-4427-96fb-90ece95bcbde for instance 3a42b833-728b-44e8-af21-fe86e25c035f on hv-cinder-85987 Oct 03 14:57:39.639695 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-f934184d-e0b1-466e-a360-a7c80a1609dd req-86f9339d-a238-4779-a514-7e626bee51d1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087283 Oct 03 14:57:39.640451 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 325/617] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:57:41.655092 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-e6d428d2-fc86-4ae3-b207-75162e438a13 req-cd7ce052-9fd0-40d5-840a-428bfeb714ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a42b833-728b-44e8-af21-fe86e25c035f", "tag": "71f04a2e-59ac-4427-96fb-90ece95bcbde"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:57:41.664830 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-e6d428d2-fc86-4ae3-b207-75162e438a13 req-cd7ce052-9fd0-40d5-840a-428bfeb714ab service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:41.665333 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-e6d428d2-fc86-4ae3-b207-75162e438a13 req-cd7ce052-9fd0-40d5-840a-428bfeb714ab service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:41.665798 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-e6d428d2-fc86-4ae3-b207-75162e438a13 req-cd7ce052-9fd0-40d5-840a-428bfeb714ab service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:41.677083 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-e6d428d2-fc86-4ae3-b207-75162e438a13 req-cd7ce052-9fd0-40d5-840a-428bfeb714ab service nova] Creating event network-changed:71f04a2e-59ac-4427-96fb-90ece95bcbde for instance 3a42b833-728b-44e8-af21-fe86e25c035f on hv-cinder-85987 Oct 03 14:57:41.682451 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-e6d428d2-fc86-4ae3-b207-75162e438a13 req-cd7ce052-9fd0-40d5-840a-428bfeb714ab service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031280 Oct 03 14:57:41.683033 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 293/618] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:57:42.888911 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-dc641671-5814-4e0e-89e6-c056d8f8bb6c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:42.889555 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-dc641671-5814-4e0e-89e6-c056d8f8bb6c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: f8993421-0b03-4554-aa82-b608a3baebe2] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:42.895568 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dc641671-5814-4e0e-89e6-c056d8f8bb6c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:42.896049 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dc641671-5814-4e0e-89e6-c056d8f8bb6c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:42.896486 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dc641671-5814-4e0e-89e6-c056d8f8bb6c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:42.897173 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dc641671-5814-4e0e-89e6-c056d8f8bb6c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:42.897703 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dc641671-5814-4e0e-89e6-c056d8f8bb6c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:42.898125 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dc641671-5814-4e0e-89e6-c056d8f8bb6c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:42.920527 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-dc641671-5814-4e0e-89e6-c056d8f8bb6c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2/ips" status: 200 len: 150 microversion: 2.1 time: 0.131524 Oct 03 14:57:42.921068 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 326/619] 10.222.0.46 () {58 vars in 1248 bytes} [Mon Oct 3 14:57:42 2022] GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2/ips => generated 150 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:57:42.934161 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-11594c11-c51c-40e2-8208-0e298a611e9e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35cd8659-2a87-46de-b13f-4e95d02ec7f5"}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:57:42.936565 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-11594c11-c51c-40e2-8208-0e298a611e9e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: f8993421-0b03-4554-aa82-b608a3baebe2] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:42.942639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-11594c11-c51c-40e2-8208-0e298a611e9e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:42.943122 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-11594c11-c51c-40e2-8208-0e298a611e9e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:42.943565 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-11594c11-c51c-40e2-8208-0e298a611e9e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:42.944259 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-11594c11-c51c-40e2-8208-0e298a611e9e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:42.944716 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-11594c11-c51c-40e2-8208-0e298a611e9e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:42.945141 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-11594c11-c51c-40e2-8208-0e298a611e9e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:43.022664 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.wsgi [None req-11594c11-c51c-40e2-8208-0e298a611e9e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] HTTP exception thrown: Invalid volume: volume 35cd8659-2a87-46de-b13f-4e95d02ec7f5 is already attached to instances: e89e5bd3-ef0d-4314-b688-10af4dbf02a8 Oct 03 14:57:43.024350 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-11594c11-c51c-40e2-8208-0e298a611e9e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Request method failure captured: Oct 03 14:57:43.024350 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: request: POST /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2/os-volume_attachments HTTP/1.1 Oct 03 14:57:43.024350 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept: application/json Oct 03 14:57:43.024350 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept-Encoding: identity Oct 03 14:57:43.024350 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Connection: close Oct 03 14:57:43.024350 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Length: 74 Oct 03 14:57:43.024350 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Type: application/json Oct 03 14:57:43.024350 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Host: 10.222.0.46 Oct 03 14:57:43.024350 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Openstack-System-Scope: None Oct 03 14:57:43.024350 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: User-Agent: python-urllib3/1.26.12 Oct 03 14:57:43.024350 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Auth-Token: gAAAAABjOvcPpmkNazTZsKwP_dytsSc1mWeaFG9s70fvVPaYpq_ArFEvYfc7mC1blzmQmSzzs7KJ6XurvcTxRDIyBJ5kvUsRB0YKc-UpccrxHapwKNSjylJR67P3ZaQN5jh2ABzG340CmXB66R8211hYQUHG14HaVU9UDOYI7_9tJ27nTjX-zUs Oct 03 14:57:43.024350 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Id: None Oct 03 14:57:43.024350 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Name: None Oct 03 14:57:43.024350 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Identity-Status: Confirmed Oct 03 14:57:43.024350 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Is-Admin-Project: True Oct 03 14:57:43.024350 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Id: default Oct 03 14:57:43.024350 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Name: Default Oct 03 14:57:43.024350 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Id: f441c0592cd146d3be851ac96cbc49dc Oct 03 14:57:43.024350 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Name: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 14:57:43.024350 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Role: member,reader Oct 03 14:57:43.024350 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Roles: member,reader Oct 03 14:57:43.025931 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 14:57:43.025931 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 14:57:43.025931 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Id: f441c0592cd146d3be851ac96cbc49dc Oct 03 14:57:43.025931 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 14:57:43.025931 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User: tempest-AttachVolumeNegativeTest-1566300421-project Oct 03 14:57:43.025931 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Id: default Oct 03 14:57:43.025931 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Name: Default Oct 03 14:57:43.025931 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Id: 89c747f18b434e469ae61755e9f639ca Oct 03 14:57:43.025931 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Name: tempest-AttachVolumeNegativeTest-1566300421-project Oct 03 14:57:43.025931 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Oct 03 14:57:43.025931 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: {"volumeAttachment": {"volumeId": "35cd8659-2a87-46de-b13f-4e95d02ec7f5"}} Oct 03 14:57:43.025931 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: method: > Oct 03 14:57:43.026859 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: exception: Invalid volume: volume 35cd8659-2a87-46de-b13f-4e95d02ec7f5 is already attached to instances: e89e5bd3-ef0d-4314-b688-10af4dbf02a8 Oct 03 14:57:43.026859 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: action_args: {'server_id': 'f8993421-0b03-4554-aa82-b608a3baebe2', 'body': {'volumeAttachment': {'volumeId': '35cd8659-2a87-46de-b13f-4e95d02ec7f5'}}} Oct 03 14:57:43.026859 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:57:43.026859 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:43.026859 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 03 14:57:43.026859 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 03 14:57:43.026859 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 14:57:43.026859 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 14:57:43.026859 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 03 14:57:43.026859 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 14:57:43.026859 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 03 14:57:43.026859 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 03 14:57:43.026859 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 03 14:57:43.026859 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 03 14:57:43.026859 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 35cd8659-2a87-46de-b13f-4e95d02ec7f5 is already attached to instances: e89e5bd3-ef0d-4314-b688-10af4dbf02a8 Oct 03 14:57:43.026859 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:57:43.026859 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:43.026859 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:57:43.026859 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:43.028235 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:43.028235 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:43.028235 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:57:43.028235 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:57:43.028235 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:57:43.028235 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:57:43.028235 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:57:43.028235 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:57:43.028235 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:57:43.028235 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:57:43.028235 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:57:43.028235 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:57:43.028235 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 03 14:57:43.028235 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 03 14:57:43.028235 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 35cd8659-2a87-46de-b13f-4e95d02ec7f5 is already attached to instances: e89e5bd3-ef0d-4314-b688-10af4dbf02a8 Oct 03 14:57:43.028235 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:57:43.028235 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:43.028235 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:57:43.028235 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:43.028235 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:43.029662 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:43.029662 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:57:43.029662 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:57:43.029662 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 35cd8659-2a87-46de-b13f-4e95d02ec7f5 is already attached to instances: e89e5bd3-ef0d-4314-b688-10af4dbf02a8 Oct 03 14:57:43.029662 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:57:43.029662 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-11594c11-c51c-40e2-8208-0e298a611e9e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Returning 400 to user: Invalid volume: volume 35cd8659-2a87-46de-b13f-4e95d02ec7f5 is already attached to instances: e89e5bd3-ef0d-4314-b688-10af4dbf02a8 {{(pid=126852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:57:43.029662 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-11594c11-c51c-40e2-8208-0e298a611e9e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "POST /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096401 Oct 03 14:57:43.029662 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 294/620] 10.222.0.46 () {60 vars in 1323 bytes} [Mon Oct 3 14:57:42 2022] POST /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 03 14:57:43.035714 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-37b0ebc6-0d17-4977-9e31-236b8c5c4e47 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:43.036244 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-37b0ebc6-0d17-4977-9e31-236b8c5c4e47 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: f8993421-0b03-4554-aa82-b608a3baebe2] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:43.042071 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-37b0ebc6-0d17-4977-9e31-236b8c5c4e47 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:43.042553 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-37b0ebc6-0d17-4977-9e31-236b8c5c4e47 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:43.042986 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-37b0ebc6-0d17-4977-9e31-236b8c5c4e47 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:43.043711 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-37b0ebc6-0d17-4977-9e31-236b8c5c4e47 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:43.044159 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-37b0ebc6-0d17-4977-9e31-236b8c5c4e47 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:43.044585 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-37b0ebc6-0d17-4977-9e31-236b8c5c4e47 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:43.068848 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-37b0ebc6-0d17-4977-9e31-236b8c5c4e47 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: f8993421-0b03-4554-aa82-b608a3baebe2] Going to try to terminate instance {{(pid=126851) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:57:43.141908 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-37b0ebc6-0d17-4977-9e31-236b8c5c4e47 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2" status: 204 len: 0 microversion: 2.1 time: 0.110151 Oct 03 14:57:43.142490 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 327/621] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 3 14:57:43 2022] DELETE /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:57:43.151876 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-df325420-f526-43cd-84b3-ff7cb10ae2df tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:43.152487 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-df325420-f526-43cd-84b3-ff7cb10ae2df tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: f8993421-0b03-4554-aa82-b608a3baebe2] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:43.159346 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-df325420-f526-43cd-84b3-ff7cb10ae2df tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:43.159825 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-df325420-f526-43cd-84b3-ff7cb10ae2df tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:43.160254 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-df325420-f526-43cd-84b3-ff7cb10ae2df tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:43.160933 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-df325420-f526-43cd-84b3-ff7cb10ae2df tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:43.161381 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-df325420-f526-43cd-84b3-ff7cb10ae2df tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:43.161827 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-df325420-f526-43cd-84b3-ff7cb10ae2df tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:43.179864 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:57:43.291795 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-df325420-f526-43cd-84b3-ff7cb10ae2df tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:43.299859 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-df325420-f526-43cd-84b3-ff7cb10ae2df tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2" status: 200 len: 1682 microversion: 2.1 time: 0.152732 Oct 03 14:57:43.300423 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 295/622] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:43 2022] GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:44.323437 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-224aa086-aacc-449a-8835-cded1c3f751f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:44.324141 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-224aa086-aacc-449a-8835-cded1c3f751f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: f8993421-0b03-4554-aa82-b608a3baebe2] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:44.330982 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-224aa086-aacc-449a-8835-cded1c3f751f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:44.331466 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-224aa086-aacc-449a-8835-cded1c3f751f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:44.331896 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-224aa086-aacc-449a-8835-cded1c3f751f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:44.332581 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-224aa086-aacc-449a-8835-cded1c3f751f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:44.333035 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-224aa086-aacc-449a-8835-cded1c3f751f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:44.333458 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-224aa086-aacc-449a-8835-cded1c3f751f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:44.463654 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-224aa086-aacc-449a-8835-cded1c3f751f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:44.471189 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-224aa086-aacc-449a-8835-cded1c3f751f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2" status: 200 len: 1682 microversion: 2.1 time: 0.152031 Oct 03 14:57:44.471753 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 328/623] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:44 2022] GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:45.495004 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-1027b98b-75bf-4573-a86b-495e6491682f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:45.495746 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-1027b98b-75bf-4573-a86b-495e6491682f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: f8993421-0b03-4554-aa82-b608a3baebe2] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:45.502347 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1027b98b-75bf-4573-a86b-495e6491682f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:45.502837 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1027b98b-75bf-4573-a86b-495e6491682f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:45.503271 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1027b98b-75bf-4573-a86b-495e6491682f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:45.503973 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1027b98b-75bf-4573-a86b-495e6491682f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:45.504441 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1027b98b-75bf-4573-a86b-495e6491682f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:45.504876 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1027b98b-75bf-4573-a86b-495e6491682f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:45.694470 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-1027b98b-75bf-4573-a86b-495e6491682f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:45.702208 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-1027b98b-75bf-4573-a86b-495e6491682f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2" status: 200 len: 1682 microversion: 2.1 time: 0.211077 Oct 03 14:57:45.702785 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 296/624] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:45 2022] GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2 => generated 1682 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:46.300101 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-9e6fc326-6df9-4239-9521-5cfc3386e50b req-315cd844-3859-4ab7-be57-554f0839393a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8993421-0b03-4554-aa82-b608a3baebe2", "name": "network-vif-deleted", "tag": "e2d275ba-9f0b-4940-b899-d1d6d34a79b3"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:57:46.312467 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-9e6fc326-6df9-4239-9521-5cfc3386e50b req-315cd844-3859-4ab7-be57-554f0839393a service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:46.313212 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-9e6fc326-6df9-4239-9521-5cfc3386e50b req-315cd844-3859-4ab7-be57-554f0839393a service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:46.314589 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-9e6fc326-6df9-4239-9521-5cfc3386e50b req-315cd844-3859-4ab7-be57-554f0839393a service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:46.327723 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-9e6fc326-6df9-4239-9521-5cfc3386e50b req-315cd844-3859-4ab7-be57-554f0839393a service nova] Creating event network-vif-deleted:e2d275ba-9f0b-4940-b899-d1d6d34a79b3 for instance f8993421-0b03-4554-aa82-b608a3baebe2 on hv-cinder-85987 Oct 03 14:57:46.335043 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-9e6fc326-6df9-4239-9521-5cfc3386e50b req-315cd844-3859-4ab7-be57-554f0839393a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039445 Oct 03 14:57:46.335970 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 329/625] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:57:46.726507 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-00f5517a-e538-4ee3-ad0c-a225f0108cf5 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:46.727168 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-00f5517a-e538-4ee3-ad0c-a225f0108cf5 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: f8993421-0b03-4554-aa82-b608a3baebe2] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:46.737576 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-00f5517a-e538-4ee3-ad0c-a225f0108cf5 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:46.738366 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-00f5517a-e538-4ee3-ad0c-a225f0108cf5 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:46.738985 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-00f5517a-e538-4ee3-ad0c-a225f0108cf5 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:46.739843 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-00f5517a-e538-4ee3-ad0c-a225f0108cf5 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:46.740459 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-00f5517a-e538-4ee3-ad0c-a225f0108cf5 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:46.741031 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-00f5517a-e538-4ee3-ad0c-a225f0108cf5 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:46.781459 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-00f5517a-e538-4ee3-ad0c-a225f0108cf5 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:46.782036 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-00f5517a-e538-4ee3-ad0c-a225f0108cf5 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:46.782469 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-00f5517a-e538-4ee3-ad0c-a225f0108cf5 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:46.782911 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.objects.instance [None req-00f5517a-e538-4ee3-ad0c-a225f0108cf5 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lazy-loading 'fault' on Instance uuid f8993421-0b03-4554-aa82-b608a3baebe2 {{(pid=126852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:57:46.826982 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-00f5517a-e538-4ee3-ad0c-a225f0108cf5 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:46.835859 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-00f5517a-e538-4ee3-ad0c-a225f0108cf5 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2" status: 200 len: 1331 microversion: 2.1 time: 0.113451 Oct 03 14:57:46.836419 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 297/626] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:46 2022] GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2 => generated 1331 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:47.859125 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-ae057857-018b-45ae-9b23-e9146bdfad4a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:47.860258 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-ae057857-018b-45ae-9b23-e9146bdfad4a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: f8993421-0b03-4554-aa82-b608a3baebe2] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:47.866991 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ae057857-018b-45ae-9b23-e9146bdfad4a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:47.867475 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ae057857-018b-45ae-9b23-e9146bdfad4a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:47.867910 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ae057857-018b-45ae-9b23-e9146bdfad4a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:47.868636 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ae057857-018b-45ae-9b23-e9146bdfad4a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:47.869130 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ae057857-018b-45ae-9b23-e9146bdfad4a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:47.869650 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ae057857-018b-45ae-9b23-e9146bdfad4a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:47.883379 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.wsgi [None req-ae057857-018b-45ae-9b23-e9146bdfad4a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] HTTP exception thrown: Instance f8993421-0b03-4554-aa82-b608a3baebe2 could not be found. Oct 03 14:57:47.884966 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-ae057857-018b-45ae-9b23-e9146bdfad4a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Request method failure captured: Oct 03 14:57:47.884966 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: request: GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2 HTTP/1.1 Oct 03 14:57:47.884966 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept: application/json Oct 03 14:57:47.884966 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept-Encoding: identity Oct 03 14:57:47.884966 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Connection: close Oct 03 14:57:47.884966 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Length: 0 Oct 03 14:57:47.884966 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Type: application/json Oct 03 14:57:47.884966 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Host: 10.222.0.46 Oct 03 14:57:47.884966 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Openstack-System-Scope: None Oct 03 14:57:47.884966 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: User-Agent: python-urllib3/1.26.12 Oct 03 14:57:47.884966 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Auth-Token: gAAAAABjOvcPpmkNazTZsKwP_dytsSc1mWeaFG9s70fvVPaYpq_ArFEvYfc7mC1blzmQmSzzs7KJ6XurvcTxRDIyBJ5kvUsRB0YKc-UpccrxHapwKNSjylJR67P3ZaQN5jh2ABzG340CmXB66R8211hYQUHG14HaVU9UDOYI7_9tJ27nTjX-zUs Oct 03 14:57:47.884966 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Id: None Oct 03 14:57:47.884966 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Name: None Oct 03 14:57:47.884966 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Identity-Status: Confirmed Oct 03 14:57:47.884966 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Is-Admin-Project: True Oct 03 14:57:47.884966 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Id: default Oct 03 14:57:47.884966 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Name: Default Oct 03 14:57:47.884966 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Id: f441c0592cd146d3be851ac96cbc49dc Oct 03 14:57:47.884966 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Name: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 14:57:47.884966 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Role: member,reader Oct 03 14:57:47.884966 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Roles: member,reader Oct 03 14:57:47.886485 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 14:57:47.886485 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 14:57:47.886485 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Id: f441c0592cd146d3be851ac96cbc49dc Oct 03 14:57:47.886485 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 14:57:47.886485 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User: tempest-AttachVolumeNegativeTest-1566300421-project Oct 03 14:57:47.886485 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Id: default Oct 03 14:57:47.886485 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Name: Default Oct 03 14:57:47.886485 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Id: 89c747f18b434e469ae61755e9f639ca Oct 03 14:57:47.886485 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Name: tempest-AttachVolumeNegativeTest-1566300421-project Oct 03 14:57:47.886485 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: method: > Oct 03 14:57:47.886485 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: exception: Instance f8993421-0b03-4554-aa82-b608a3baebe2 could not be found. Oct 03 14:57:47.886485 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: action_args: {'id': 'f8993421-0b03-4554-aa82-b608a3baebe2'} Oct 03 14:57:47.887350 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:57:47.887350 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:47.887350 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:57:47.887350 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:57:47.887350 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:57:47.887350 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:57:47.887350 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:57:47.887350 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:57:47.887350 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:57:47.887350 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:57:47.887350 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8993421-0b03-4554-aa82-b608a3baebe2 could not be found. Oct 03 14:57:47.887350 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:57:47.887350 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:47.887350 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:57:47.887350 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:47.887350 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:47.887350 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:47.887350 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:57:47.887350 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:57:47.887350 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:57:47.888745 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:57:47.888745 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:57:47.888745 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:57:47.888745 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:57:47.888745 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:57:47.888745 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:57:47.888745 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:57:47.888745 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8993421-0b03-4554-aa82-b608a3baebe2 could not be found. Oct 03 14:57:47.888745 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:57:47.888745 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:47.888745 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:57:47.888745 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:47.888745 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:47.888745 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:47.888745 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:57:47.888745 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:57:47.888745 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8993421-0b03-4554-aa82-b608a3baebe2 could not be found. Oct 03 14:57:47.888745 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:57:47.890056 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-ae057857-018b-45ae-9b23-e9146bdfad4a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Returning 404 to user: Instance f8993421-0b03-4554-aa82-b608a3baebe2 could not be found. {{(pid=126851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:57:47.890056 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-ae057857-018b-45ae-9b23-e9146bdfad4a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2" status: 404 len: 111 microversion: 2.1 time: 0.031562 Oct 03 14:57:47.890056 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 330/627] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:47 2022] GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:57:47.895245 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-cf3dea19-b060-4920-9032-08d24b5de624 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '.version_select at 0x7fe0d356dc10>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:47.902147 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_api:SELECT=37 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:57:47.915254 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-cf3dea19-b060-4920-9032-08d24b5de624 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-812412667" status: 202 len: 0 microversion: 2.1 time: 0.023721 Oct 03 14:57:47.915811 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 298/628] 10.222.0.46 () {58 vars in 1218 bytes} [Mon Oct 3 14:57:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-812412667 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:57:48.614568 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-fdc7b318-76f1-4e5e-b5cd-b284049ad727 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:48.615060 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-fdc7b318-76f1-4e5e-b5cd-b284049ad727 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:48.620999 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fdc7b318-76f1-4e5e-b5cd-b284049ad727 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:48.621479 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fdc7b318-76f1-4e5e-b5cd-b284049ad727 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:48.621942 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fdc7b318-76f1-4e5e-b5cd-b284049ad727 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:48.622657 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fdc7b318-76f1-4e5e-b5cd-b284049ad727 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:48.623114 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fdc7b318-76f1-4e5e-b5cd-b284049ad727 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:48.623535 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fdc7b318-76f1-4e5e-b5cd-b284049ad727 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:48.627389 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:57:48.704696 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.objects.instance [None req-fdc7b318-76f1-4e5e-b5cd-b284049ad727 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lazy-loading 'services' on Instance uuid e89e5bd3-ef0d-4314-b688-10af4dbf02a8 {{(pid=126851) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:57:48.827083 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-fdc7b318-76f1-4e5e-b5cd-b284049ad727 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8/os-volume_attachments/35cd8659-2a87-46de-b13f-4e95d02ec7f5" status: 202 len: 0 microversion: 2.1 time: 0.216242 Oct 03 14:57:48.827686 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 331/629] 10.222.0.46 () {58 vars in 1416 bytes} [Mon Oct 3 14:57:48 2022] DELETE /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8/os-volume_attachments/35cd8659-2a87-46de-b13f-4e95d02ec7f5 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:57:48.837257 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-fa2bd452-9242-4ec4-b849-5b90e98d2ffa tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:48.839226 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-fa2bd452-9242-4ec4-b849-5b90e98d2ffa tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:48.847213 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fa2bd452-9242-4ec4-b849-5b90e98d2ffa tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:48.847751 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fa2bd452-9242-4ec4-b849-5b90e98d2ffa tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:48.848263 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fa2bd452-9242-4ec4-b849-5b90e98d2ffa tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:48.849071 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fa2bd452-9242-4ec4-b849-5b90e98d2ffa tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:48.849581 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fa2bd452-9242-4ec4-b849-5b90e98d2ffa tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:48.850010 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fa2bd452-9242-4ec4-b849-5b90e98d2ffa tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:48.879802 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-fa2bd452-9242-4ec4-b849-5b90e98d2ffa tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047262 Oct 03 14:57:48.880369 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 299/630] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 3 14:57:48 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:57:49.892732 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-852beba6-1770-47c0-8e58-b15a8f325aa8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:49.895253 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-852beba6-1770-47c0-8e58-b15a8f325aa8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:49.901365 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-852beba6-1770-47c0-8e58-b15a8f325aa8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:49.901886 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-852beba6-1770-47c0-8e58-b15a8f325aa8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:49.902324 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-852beba6-1770-47c0-8e58-b15a8f325aa8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:49.903012 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-852beba6-1770-47c0-8e58-b15a8f325aa8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:49.903469 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-852beba6-1770-47c0-8e58-b15a8f325aa8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:49.903894 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-852beba6-1770-47c0-8e58-b15a8f325aa8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:49.934551 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-852beba6-1770-47c0-8e58-b15a8f325aa8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046502 Oct 03 14:57:49.935225 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 332/631] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 3 14:57:49 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:57:50.947045 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-c397fc0d-217c-433b-b192-edab798d8503 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:50.949213 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-c397fc0d-217c-433b-b192-edab798d8503 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:50.955468 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c397fc0d-217c-433b-b192-edab798d8503 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:50.955951 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c397fc0d-217c-433b-b192-edab798d8503 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:50.956384 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c397fc0d-217c-433b-b192-edab798d8503 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:50.957073 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c397fc0d-217c-433b-b192-edab798d8503 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:50.957544 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c397fc0d-217c-433b-b192-edab798d8503 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:50.957972 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c397fc0d-217c-433b-b192-edab798d8503 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:50.986284 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-c397fc0d-217c-433b-b192-edab798d8503 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043159 Oct 03 14:57:50.986829 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 300/632] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 3 14:57:50 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:57:51.048742 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-145f6726-bb21-4e0a-82d8-79fa7dbd4419 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:51.049238 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-145f6726-bb21-4e0a-82d8-79fa7dbd4419 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:51.055969 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-145f6726-bb21-4e0a-82d8-79fa7dbd4419 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:51.056536 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-145f6726-bb21-4e0a-82d8-79fa7dbd4419 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:51.057099 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-145f6726-bb21-4e0a-82d8-79fa7dbd4419 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:51.058093 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-145f6726-bb21-4e0a-82d8-79fa7dbd4419 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:51.058519 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-145f6726-bb21-4e0a-82d8-79fa7dbd4419 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:51.058958 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-145f6726-bb21-4e0a-82d8-79fa7dbd4419 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:51.084585 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-145f6726-bb21-4e0a-82d8-79fa7dbd4419 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Going to try to terminate instance {{(pid=126851) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:57:51.157517 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-145f6726-bb21-4e0a-82d8-79fa7dbd4419 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 204 len: 0 microversion: 2.1 time: 0.112823 Oct 03 14:57:51.158216 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 333/633] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 3 14:57:51 2022] DELETE /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:57:51.166736 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-b92364db-d4ba-4fc6-9929-28bc990fe93a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:51.167394 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-b92364db-d4ba-4fc6-9929-28bc990fe93a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:51.173775 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b92364db-d4ba-4fc6-9929-28bc990fe93a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:51.174258 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b92364db-d4ba-4fc6-9929-28bc990fe93a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:51.174695 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b92364db-d4ba-4fc6-9929-28bc990fe93a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:51.175388 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b92364db-d4ba-4fc6-9929-28bc990fe93a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:51.175841 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b92364db-d4ba-4fc6-9929-28bc990fe93a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:51.176307 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b92364db-d4ba-4fc6-9929-28bc990fe93a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:51.304889 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-b92364db-d4ba-4fc6-9929-28bc990fe93a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:51.312558 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-b92364db-d4ba-4fc6-9929-28bc990fe93a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 200 len: 1681 microversion: 2.1 time: 0.149602 Oct 03 14:57:51.313113 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 301/634] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:51 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:52.336501 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-5be56197-e599-4aea-9bb9-2b57c5d08253 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:52.337204 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-5be56197-e599-4aea-9bb9-2b57c5d08253 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:52.343677 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5be56197-e599-4aea-9bb9-2b57c5d08253 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:52.344684 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5be56197-e599-4aea-9bb9-2b57c5d08253 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:52.345125 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5be56197-e599-4aea-9bb9-2b57c5d08253 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:52.345856 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5be56197-e599-4aea-9bb9-2b57c5d08253 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:52.346322 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5be56197-e599-4aea-9bb9-2b57c5d08253 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:52.346749 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5be56197-e599-4aea-9bb9-2b57c5d08253 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:52.473649 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-5be56197-e599-4aea-9bb9-2b57c5d08253 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:52.481370 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-5be56197-e599-4aea-9bb9-2b57c5d08253 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 200 len: 1681 microversion: 2.1 time: 0.149369 Oct 03 14:57:52.481963 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 334/635] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:52 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:53.427111 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-a4bc8f36-05a8-4735-8cff-f1654ed4594e req-cfa26294-e854-4cc4-8bb0-43e780d20e25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e89e5bd3-ef0d-4314-b688-10af4dbf02a8", "name": "network-vif-deleted", "tag": "9bdcc1e0-93a1-4a48-839a-e6c7d4339e25"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:57:53.439132 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-a4bc8f36-05a8-4735-8cff-f1654ed4594e req-cfa26294-e854-4cc4-8bb0-43e780d20e25 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:53.439638 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-a4bc8f36-05a8-4735-8cff-f1654ed4594e req-cfa26294-e854-4cc4-8bb0-43e780d20e25 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:53.440072 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-a4bc8f36-05a8-4735-8cff-f1654ed4594e req-cfa26294-e854-4cc4-8bb0-43e780d20e25 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:53.451297 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-a4bc8f36-05a8-4735-8cff-f1654ed4594e req-cfa26294-e854-4cc4-8bb0-43e780d20e25 service nova] Creating event network-vif-deleted:9bdcc1e0-93a1-4a48-839a-e6c7d4339e25 for instance e89e5bd3-ef0d-4314-b688-10af4dbf02a8 on hv-cinder-85987 Oct 03 14:57:53.456186 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-a4bc8f36-05a8-4735-8cff-f1654ed4594e req-cfa26294-e854-4cc4-8bb0-43e780d20e25 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032741 Oct 03 14:57:53.456782 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 302/636] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:57:53.506134 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-031d6410-f4a9-47f6-9dab-bc236acffbcd tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:53.507668 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-031d6410-f4a9-47f6-9dab-bc236acffbcd tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:53.513936 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 14:57:53.514327 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Mon Oct 3 14:57:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 (ip 10.222.0.46) !!! Oct 03 14:57:53.518243 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-031d6410-f4a9-47f6-9dab-bc236acffbcd tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:53.519116 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-031d6410-f4a9-47f6-9dab-bc236acffbcd tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:53.519553 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-031d6410-f4a9-47f6-9dab-bc236acffbcd tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:53.520262 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-031d6410-f4a9-47f6-9dab-bc236acffbcd tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:53.520865 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-031d6410-f4a9-47f6-9dab-bc236acffbcd tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:53.521432 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-031d6410-f4a9-47f6-9dab-bc236acffbcd tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:53.598349 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-031d6410-f4a9-47f6-9dab-bc236acffbcd tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:53.607361 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-031d6410-f4a9-47f6-9dab-bc236acffbcd tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 200 len: 1327 microversion: 2.1 time: 0.106178 Oct 03 14:57:53.614466 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 335/637] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:53 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 1327 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:54.637371 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-d4d2e34a-4778-4238-9c68-298fef0c523f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:54.638090 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-d4d2e34a-4778-4238-9c68-298fef0c523f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:54.644191 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d4d2e34a-4778-4238-9c68-298fef0c523f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:54.644668 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d4d2e34a-4778-4238-9c68-298fef0c523f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:54.645098 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d4d2e34a-4778-4238-9c68-298fef0c523f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:54.645804 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d4d2e34a-4778-4238-9c68-298fef0c523f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:54.646255 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d4d2e34a-4778-4238-9c68-298fef0c523f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:54.646673 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d4d2e34a-4778-4238-9c68-298fef0c523f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:54.660001 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.wsgi [None req-d4d2e34a-4778-4238-9c68-298fef0c523f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] HTTP exception thrown: Instance e89e5bd3-ef0d-4314-b688-10af4dbf02a8 could not be found. Oct 03 14:57:54.661582 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-d4d2e34a-4778-4238-9c68-298fef0c523f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Request method failure captured: Oct 03 14:57:54.661582 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: request: GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 HTTP/1.1 Oct 03 14:57:54.661582 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept: application/json Oct 03 14:57:54.661582 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept-Encoding: identity Oct 03 14:57:54.661582 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Connection: close Oct 03 14:57:54.661582 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Length: 0 Oct 03 14:57:54.661582 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Type: application/json Oct 03 14:57:54.661582 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Host: 10.222.0.46 Oct 03 14:57:54.661582 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Openstack-System-Scope: None Oct 03 14:57:54.661582 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: User-Agent: python-urllib3/1.26.12 Oct 03 14:57:54.661582 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Auth-Token: gAAAAABjOvcPpmkNazTZsKwP_dytsSc1mWeaFG9s70fvVPaYpq_ArFEvYfc7mC1blzmQmSzzs7KJ6XurvcTxRDIyBJ5kvUsRB0YKc-UpccrxHapwKNSjylJR67P3ZaQN5jh2ABzG340CmXB66R8211hYQUHG14HaVU9UDOYI7_9tJ27nTjX-zUs Oct 03 14:57:54.661582 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Id: None Oct 03 14:57:54.661582 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Name: None Oct 03 14:57:54.661582 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Identity-Status: Confirmed Oct 03 14:57:54.661582 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Is-Admin-Project: True Oct 03 14:57:54.661582 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Id: default Oct 03 14:57:54.661582 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Name: Default Oct 03 14:57:54.661582 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Id: f441c0592cd146d3be851ac96cbc49dc Oct 03 14:57:54.661582 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Name: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 14:57:54.661582 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Role: member,reader Oct 03 14:57:54.661582 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Roles: member,reader Oct 03 14:57:54.663208 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 14:57:54.663208 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 14:57:54.663208 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Id: f441c0592cd146d3be851ac96cbc49dc Oct 03 14:57:54.663208 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 14:57:54.663208 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User: tempest-AttachVolumeNegativeTest-1566300421-project Oct 03 14:57:54.663208 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Id: default Oct 03 14:57:54.663208 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Name: Default Oct 03 14:57:54.663208 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Id: 89c747f18b434e469ae61755e9f639ca Oct 03 14:57:54.663208 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Name: tempest-AttachVolumeNegativeTest-1566300421-project Oct 03 14:57:54.663208 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: method: > Oct 03 14:57:54.663208 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: exception: Instance e89e5bd3-ef0d-4314-b688-10af4dbf02a8 could not be found. Oct 03 14:57:54.663208 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: action_args: {'id': 'e89e5bd3-ef0d-4314-b688-10af4dbf02a8'} Oct 03 14:57:54.664102 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:57:54.664102 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:54.664102 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:57:54.664102 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:57:54.664102 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:57:54.664102 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:57:54.664102 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:57:54.664102 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:57:54.664102 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:57:54.664102 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:57:54.664102 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e89e5bd3-ef0d-4314-b688-10af4dbf02a8 could not be found. Oct 03 14:57:54.664102 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:57:54.664102 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:54.664102 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:57:54.664102 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:54.664102 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:54.664102 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:54.664102 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:57:54.664102 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:57:54.664102 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:57:54.665562 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:57:54.665562 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:57:54.665562 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:57:54.665562 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:57:54.665562 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:57:54.665562 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:57:54.665562 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:57:54.665562 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e89e5bd3-ef0d-4314-b688-10af4dbf02a8 could not be found. Oct 03 14:57:54.665562 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:57:54.665562 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:54.665562 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:57:54.665562 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:54.665562 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:54.665562 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:54.665562 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:57:54.665562 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:57:54.665562 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e89e5bd3-ef0d-4314-b688-10af4dbf02a8 could not be found. Oct 03 14:57:54.665562 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:57:54.666827 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-d4d2e34a-4778-4238-9c68-298fef0c523f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Returning 404 to user: Instance e89e5bd3-ef0d-4314-b688-10af4dbf02a8 could not be found. {{(pid=126852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:57:54.666827 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-d4d2e34a-4778-4238-9c68-298fef0c523f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 404 len: 111 microversion: 2.1 time: 0.030287 Oct 03 14:57:54.666827 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 303/638] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:54 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:57:54.672873 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-73bf8b0c-1d7d-49a2-bcd1-675a76e20851 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '.version_select at 0x7fe0d6d3a940>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:54.696070 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-73bf8b0c-1d7d-49a2-bcd1-675a76e20851 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1117189096" status: 202 len: 0 microversion: 2.1 time: 0.027443 Oct 03 14:57:54.696668 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 336/639] 10.222.0.46 () {58 vars in 1221 bytes} [Mon Oct 3 14:57:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1117189096 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:57:55.314311 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-66ec0ded-f152-4806-a9aa-ae0373441279 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Action: 'create', calling method: .version_select at 0x7fe0d340c700>, body: {"keypair": {"name": "tempest-keypair-1803949040", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5Pz78Ru85mbQps1i93Ja1JE0NhQB+KRllKUH6ukA56TrV1owpfdKhtTP8x7pKmyo0O4/POa0im/J6ijiPn1AY3EcfjGGXc6rh+h4xSAyAm7FUZSL/Gby8Tvcppm1ycYg=="}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:57:55.329468 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-66ec0ded-f152-4806-a9aa-ae0373441279 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Getting quotas for project f441c0592cd146d3be851ac96cbc49dc. Resources: {'key_pairs'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:57:55.333109 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-66ec0ded-f152-4806-a9aa-ae0373441279 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Getting quotas for user 89c747f18b434e469ae61755e9f639ca and project f441c0592cd146d3be851ac96cbc49dc. Resources: {'key_pairs'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:57:55.354810 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-66ec0ded-f152-4806-a9aa-ae0373441279 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044328 Oct 03 14:57:55.355406 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 304/640] 10.222.0.46 () {60 vars in 1159 bytes} [Mon Oct 3 14:57:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:57:56.539171 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-fc0f0137-c693-4814-b56f-b2ae1b3e0080 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1000512588", "imageRef": "add7a872-2ca1-4366-9a93-f0663fdb297b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3b88fdf3-b260-41ad-9765-7cbb7b33b8ed"}], "security_groups": [{"name": "tempest-securitygroup--69783814"}], "key_name": "tempest-keypair-1803949040", "user_data": "}} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:57:56.642360 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.network.neutron [None req-fc0f0137-c693-4814-b56f-b2ae1b3e0080 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] validate_networks() for [('3b88fdf3-b260-41ad-9765-7cbb7b33b8ed', None, None, None, None, None)] {{(pid=126851) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:57:57.040677 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-fc0f0137-c693-4814-b56f-b2ae1b3e0080 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Flavor limits 0:0:0 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:57:57.041087 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-fc0f0137-c693-4814-b56f-b2ae1b3e0080 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Image limits 0:0:0 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:57:57.041602 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-fc0f0137-c693-4814-b56f-b2ae1b3e0080 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Flavor pref 0:0:0 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:57:57.042010 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-fc0f0137-c693-4814-b56f-b2ae1b3e0080 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Image pref 0:0:0 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:57:57.042416 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-fc0f0137-c693-4814-b56f-b2ae1b3e0080 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:57:57.050904 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fc0f0137-c693-4814-b56f-b2ae1b3e0080 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:57.051379 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fc0f0137-c693-4814-b56f-b2ae1b3e0080 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:57.051813 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fc0f0137-c693-4814-b56f-b2ae1b3e0080 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:57.052547 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fc0f0137-c693-4814-b56f-b2ae1b3e0080 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:57.052972 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fc0f0137-c693-4814-b56f-b2ae1b3e0080 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:57.053386 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fc0f0137-c693-4814-b56f-b2ae1b3e0080 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:57.070262 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.quota [None req-fc0f0137-c693-4814-b56f-b2ae1b3e0080 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Getting quotas for project f441c0592cd146d3be851ac96cbc49dc. Resources: {'ram', 'instances', 'cores'} {{(pid=126851) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:57:57.074171 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.quota [None req-fc0f0137-c693-4814-b56f-b2ae1b3e0080 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Getting quotas for user 89c747f18b434e469ae61755e9f639ca and project f441c0592cd146d3be851ac96cbc49dc. Resources: {'ram', 'instances', 'cores'} {{(pid=126851) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:57:57.085083 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-fc0f0137-c693-4814-b56f-b2ae1b3e0080 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Going to run 1 instances... {{(pid=126851) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:57:57.087645 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-fc0f0137-c693-4814-b56f-b2ae1b3e0080 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 78499c1b-6aff-4bab-8bc4-495a949e3637] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='add7a872-2ca1-4366-9a93-f0663fdb297b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126851) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:57:57.136575 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-fc0f0137-c693-4814-b56f-b2ae1b3e0080 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.602022 Oct 03 14:57:57.137214 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 337/641] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 3 14:57:56 2022] POST /compute/v2.1/servers => generated 400 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:57:57.149564 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-aac5727d-ad92-4da9-a346-bacc50110bc8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:57.150263 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-aac5727d-ad92-4da9-a346-bacc50110bc8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 78499c1b-6aff-4bab-8bc4-495a949e3637] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:57.204496 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-aac5727d-ad92-4da9-a346-bacc50110bc8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:57.212709 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-aac5727d-ad92-4da9-a346-bacc50110bc8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637" status: 200 len: 1242 microversion: 2.1 time: 0.067466 Oct 03 14:57:57.213368 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 305/642] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:57 2022] GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637 => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:58.235925 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-39897d86-6f30-4eb7-9532-a5a5cecb2061 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:58.236557 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-39897d86-6f30-4eb7-9532-a5a5cecb2061 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 78499c1b-6aff-4bab-8bc4-495a949e3637] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:58.242500 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-39897d86-6f30-4eb7-9532-a5a5cecb2061 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:58.242981 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-39897d86-6f30-4eb7-9532-a5a5cecb2061 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:58.243418 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-39897d86-6f30-4eb7-9532-a5a5cecb2061 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:58.244099 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-39897d86-6f30-4eb7-9532-a5a5cecb2061 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:58.244552 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-39897d86-6f30-4eb7-9532-a5a5cecb2061 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:58.244974 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-39897d86-6f30-4eb7-9532-a5a5cecb2061 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:58.304792 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-39897d86-6f30-4eb7-9532-a5a5cecb2061 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:58.312972 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-39897d86-6f30-4eb7-9532-a5a5cecb2061 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637" status: 200 len: 1294 microversion: 2.1 time: 0.080780 Oct 03 14:57:58.313549 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 338/643] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:58 2022] GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637 => generated 1294 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:59.336155 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-3d7242d1-ff7b-44e0-a7d0-7aa8705d81af tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:59.337118 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-3d7242d1-ff7b-44e0-a7d0-7aa8705d81af tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 78499c1b-6aff-4bab-8bc4-495a949e3637] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:59.345392 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3d7242d1-ff7b-44e0-a7d0-7aa8705d81af tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:59.345908 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3d7242d1-ff7b-44e0-a7d0-7aa8705d81af tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:59.346368 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3d7242d1-ff7b-44e0-a7d0-7aa8705d81af tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:59.347063 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3d7242d1-ff7b-44e0-a7d0-7aa8705d81af tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:59.347543 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3d7242d1-ff7b-44e0-a7d0-7aa8705d81af tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:59.347989 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3d7242d1-ff7b-44e0-a7d0-7aa8705d81af tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:59.431106 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-3d7242d1-ff7b-44e0-a7d0-7aa8705d81af tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:59.439091 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-3d7242d1-ff7b-44e0-a7d0-7aa8705d81af tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637" status: 200 len: 1300 microversion: 2.1 time: 0.107451 Oct 03 14:57:59.439654 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 306/644] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:59 2022] GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637 => generated 1300 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:00.408947 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-b30cc162-3cc0-4aea-8cc4-111f18c8365d req-d85ff376-6468-4b49-8c9e-b5c676aba11e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78499c1b-6aff-4bab-8bc4-495a949e3637", "tag": "328cb0d5-d75b-4a12-a5bf-4bf57d2686b1"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:58:00.419073 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-b30cc162-3cc0-4aea-8cc4-111f18c8365d req-d85ff376-6468-4b49-8c9e-b5c676aba11e service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:00.419548 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-b30cc162-3cc0-4aea-8cc4-111f18c8365d req-d85ff376-6468-4b49-8c9e-b5c676aba11e service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:00.419969 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-b30cc162-3cc0-4aea-8cc4-111f18c8365d req-d85ff376-6468-4b49-8c9e-b5c676aba11e service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:00.431355 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-b30cc162-3cc0-4aea-8cc4-111f18c8365d req-d85ff376-6468-4b49-8c9e-b5c676aba11e service nova] Creating event network-changed:328cb0d5-d75b-4a12-a5bf-4bf57d2686b1 for instance 78499c1b-6aff-4bab-8bc4-495a949e3637 on hv-cinder-85987 Oct 03 14:58:00.436231 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-b30cc162-3cc0-4aea-8cc4-111f18c8365d req-d85ff376-6468-4b49-8c9e-b5c676aba11e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030948 Oct 03 14:58:00.436824 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 339/645] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:58:00.463722 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-b8fc1a14-9073-4d2a-8413-f774501caf9f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:00.464192 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-b8fc1a14-9073-4d2a-8413-f774501caf9f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 78499c1b-6aff-4bab-8bc4-495a949e3637] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:00.470886 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b8fc1a14-9073-4d2a-8413-f774501caf9f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:00.471368 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b8fc1a14-9073-4d2a-8413-f774501caf9f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:00.471799 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b8fc1a14-9073-4d2a-8413-f774501caf9f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:00.472491 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b8fc1a14-9073-4d2a-8413-f774501caf9f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:00.472936 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b8fc1a14-9073-4d2a-8413-f774501caf9f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:00.473357 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b8fc1a14-9073-4d2a-8413-f774501caf9f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:00.678534 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-b8fc1a14-9073-4d2a-8413-f774501caf9f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:00.689365 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-b8fc1a14-9073-4d2a-8413-f774501caf9f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637" status: 200 len: 1366 microversion: 2.1 time: 0.230235 Oct 03 14:58:00.690013 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 307/646] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:00 2022] GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:01.721705 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-6a42c1b6-c867-49dd-93ce-705f0e0827d8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:01.722399 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-6a42c1b6-c867-49dd-93ce-705f0e0827d8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 78499c1b-6aff-4bab-8bc4-495a949e3637] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:01.728454 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6a42c1b6-c867-49dd-93ce-705f0e0827d8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:01.728930 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6a42c1b6-c867-49dd-93ce-705f0e0827d8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:01.729354 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6a42c1b6-c867-49dd-93ce-705f0e0827d8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:01.730076 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6a42c1b6-c867-49dd-93ce-705f0e0827d8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:01.730526 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6a42c1b6-c867-49dd-93ce-705f0e0827d8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:01.730943 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6a42c1b6-c867-49dd-93ce-705f0e0827d8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:01.862073 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-6a42c1b6-c867-49dd-93ce-705f0e0827d8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:01.869582 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-6a42c1b6-c867-49dd-93ce-705f0e0827d8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637" status: 200 len: 1366 microversion: 2.1 time: 0.153100 Oct 03 14:58:01.870145 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 340/647] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:01 2022] GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:02.892250 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-24e0a92a-103d-46a6-84b5-8235e222cdeb tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:02.892911 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-24e0a92a-103d-46a6-84b5-8235e222cdeb tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 78499c1b-6aff-4bab-8bc4-495a949e3637] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:02.898836 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-24e0a92a-103d-46a6-84b5-8235e222cdeb tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:02.899317 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-24e0a92a-103d-46a6-84b5-8235e222cdeb tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:02.899749 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-24e0a92a-103d-46a6-84b5-8235e222cdeb tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:02.900427 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-24e0a92a-103d-46a6-84b5-8235e222cdeb tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:02.900883 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-24e0a92a-103d-46a6-84b5-8235e222cdeb tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:02.901302 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-24e0a92a-103d-46a6-84b5-8235e222cdeb tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:03.026512 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-24e0a92a-103d-46a6-84b5-8235e222cdeb tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:03.034657 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-24e0a92a-103d-46a6-84b5-8235e222cdeb tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637" status: 200 len: 1366 microversion: 2.1 time: 0.146701 Oct 03 14:58:03.035215 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 308/648] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:02 2022] GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:04.057102 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-5378e322-e4b3-4d3d-9120-4b5a91055ac9 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:04.057746 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-5378e322-e4b3-4d3d-9120-4b5a91055ac9 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 78499c1b-6aff-4bab-8bc4-495a949e3637] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:04.060160 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:58:04.065881 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5378e322-e4b3-4d3d-9120-4b5a91055ac9 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:04.066371 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5378e322-e4b3-4d3d-9120-4b5a91055ac9 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:04.066807 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5378e322-e4b3-4d3d-9120-4b5a91055ac9 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:04.067510 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5378e322-e4b3-4d3d-9120-4b5a91055ac9 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:04.067963 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5378e322-e4b3-4d3d-9120-4b5a91055ac9 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:04.068385 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5378e322-e4b3-4d3d-9120-4b5a91055ac9 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:04.198358 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-5378e322-e4b3-4d3d-9120-4b5a91055ac9 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:04.206617 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-5378e322-e4b3-4d3d-9120-4b5a91055ac9 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637" status: 200 len: 1366 microversion: 2.1 time: 0.153311 Oct 03 14:58:04.207194 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 341/649] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:04 2022] GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:05.229416 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-a2324e2f-f003-45b2-9799-ff93f0727d0e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:05.230076 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-a2324e2f-f003-45b2-9799-ff93f0727d0e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 78499c1b-6aff-4bab-8bc4-495a949e3637] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:05.236457 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a2324e2f-f003-45b2-9799-ff93f0727d0e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:05.236941 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a2324e2f-f003-45b2-9799-ff93f0727d0e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:05.237375 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a2324e2f-f003-45b2-9799-ff93f0727d0e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:05.238086 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a2324e2f-f003-45b2-9799-ff93f0727d0e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:05.238545 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a2324e2f-f003-45b2-9799-ff93f0727d0e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:05.238969 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a2324e2f-f003-45b2-9799-ff93f0727d0e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:05.396441 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-a2324e2f-f003-45b2-9799-ff93f0727d0e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:05.403966 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-a2324e2f-f003-45b2-9799-ff93f0727d0e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637" status: 200 len: 1366 microversion: 2.1 time: 0.178400 Oct 03 14:58:05.404533 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 309/650] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:05 2022] GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:06.427553 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-9c31c19c-d585-429a-b36e-f780e47340cb tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:06.428169 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-9c31c19c-d585-429a-b36e-f780e47340cb tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 78499c1b-6aff-4bab-8bc4-495a949e3637] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:06.434619 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9c31c19c-d585-429a-b36e-f780e47340cb tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:06.435101 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9c31c19c-d585-429a-b36e-f780e47340cb tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:06.435536 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9c31c19c-d585-429a-b36e-f780e47340cb tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:06.436228 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9c31c19c-d585-429a-b36e-f780e47340cb tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:06.436687 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9c31c19c-d585-429a-b36e-f780e47340cb tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:06.437111 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9c31c19c-d585-429a-b36e-f780e47340cb tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:06.567335 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-9c31c19c-d585-429a-b36e-f780e47340cb tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:06.574972 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-9c31c19c-d585-429a-b36e-f780e47340cb tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637" status: 200 len: 1366 microversion: 2.1 time: 0.151289 Oct 03 14:58:06.575525 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 342/651] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:06 2022] GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:06.668519 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-30ce38ea-0c16-4a81-a09d-5c56173ad23a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:06.669115 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-30ce38ea-0c16-4a81-a09d-5c56173ad23a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:06.676002 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-30ce38ea-0c16-4a81-a09d-5c56173ad23a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:06.676483 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-30ce38ea-0c16-4a81-a09d-5c56173ad23a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:06.676917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-30ce38ea-0c16-4a81-a09d-5c56173ad23a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:06.677639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-30ce38ea-0c16-4a81-a09d-5c56173ad23a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:06.678094 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-30ce38ea-0c16-4a81-a09d-5c56173ad23a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:06.678513 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-30ce38ea-0c16-4a81-a09d-5c56173ad23a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:06.702971 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-30ce38ea-0c16-4a81-a09d-5c56173ad23a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Going to try to terminate instance {{(pid=126852) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:58:06.779309 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-30ce38ea-0c16-4a81-a09d-5c56173ad23a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 204 len: 0 microversion: 2.1 time: 0.114330 Oct 03 14:58:06.779982 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 310/652] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 3 14:58:06 2022] DELETE /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:58:06.788513 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-74833338-edb4-4a34-a8a9-d42ac653f262 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:06.789153 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-74833338-edb4-4a34-a8a9-d42ac653f262 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:06.794948 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-74833338-edb4-4a34-a8a9-d42ac653f262 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:06.795420 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-74833338-edb4-4a34-a8a9-d42ac653f262 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:06.795845 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-74833338-edb4-4a34-a8a9-d42ac653f262 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:06.797036 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-74833338-edb4-4a34-a8a9-d42ac653f262 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:06.797486 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-74833338-edb4-4a34-a8a9-d42ac653f262 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:06.797927 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-74833338-edb4-4a34-a8a9-d42ac653f262 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:06.928615 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-74833338-edb4-4a34-a8a9-d42ac653f262 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:06.936192 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-74833338-edb4-4a34-a8a9-d42ac653f262 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 200 len: 1578 microversion: 2.1 time: 0.151859 Oct 03 14:58:06.936774 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 343/653] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:06 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 1578 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:07.598869 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-b35d5013-d619-46e3-b166-291479a12e0a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:07.599560 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-b35d5013-d619-46e3-b166-291479a12e0a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 78499c1b-6aff-4bab-8bc4-495a949e3637] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:07.601431 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell0:SELECT=6 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:58:07.606808 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b35d5013-d619-46e3-b166-291479a12e0a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:07.607292 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b35d5013-d619-46e3-b166-291479a12e0a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:07.607725 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b35d5013-d619-46e3-b166-291479a12e0a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:07.608487 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b35d5013-d619-46e3-b166-291479a12e0a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:07.608944 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b35d5013-d619-46e3-b166-291479a12e0a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:07.609359 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b35d5013-d619-46e3-b166-291479a12e0a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:07.742494 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-b35d5013-d619-46e3-b166-291479a12e0a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:07.750711 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-b35d5013-d619-46e3-b166-291479a12e0a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637" status: 200 len: 1366 microversion: 2.1 time: 0.156167 Oct 03 14:58:07.751282 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 311/654] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:07 2022] GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:07.847172 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell0:SELECT=2 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:58:07.847986 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell0:SELECT=6 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:58:07.904156 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-f2d6b4f1-3ae9-4ffa-a416-b296270b35b8 req-56557bf3-3b3e-48be-bf85-34106225d948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78499c1b-6aff-4bab-8bc4-495a949e3637", "name": "network-vif-plugged", "status": "completed", "tag": "328cb0d5-d75b-4a12-a5bf-4bf57d2686b1"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:58:07.913476 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-f2d6b4f1-3ae9-4ffa-a416-b296270b35b8 req-56557bf3-3b3e-48be-bf85-34106225d948 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:07.913978 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-f2d6b4f1-3ae9-4ffa-a416-b296270b35b8 req-56557bf3-3b3e-48be-bf85-34106225d948 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:07.914410 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-f2d6b4f1-3ae9-4ffa-a416-b296270b35b8 req-56557bf3-3b3e-48be-bf85-34106225d948 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:07.925095 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-f2d6b4f1-3ae9-4ffa-a416-b296270b35b8 req-56557bf3-3b3e-48be-bf85-34106225d948 service nova] Creating event network-vif-plugged:328cb0d5-d75b-4a12-a5bf-4bf57d2686b1 for instance 78499c1b-6aff-4bab-8bc4-495a949e3637 on hv-cinder-85987 Oct 03 14:58:07.929823 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-f2d6b4f1-3ae9-4ffa-a416-b296270b35b8 req-56557bf3-3b3e-48be-bf85-34106225d948 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086998 Oct 03 14:58:07.930835 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 344/655] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:58:07.959210 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-f6120e94-7b49-4f18-b496-028e2d148e83 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:07.959850 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-f6120e94-7b49-4f18-b496-028e2d148e83 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:07.965892 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f6120e94-7b49-4f18-b496-028e2d148e83 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:07.966374 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f6120e94-7b49-4f18-b496-028e2d148e83 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:07.966811 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f6120e94-7b49-4f18-b496-028e2d148e83 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:07.967500 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f6120e94-7b49-4f18-b496-028e2d148e83 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:07.967957 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f6120e94-7b49-4f18-b496-028e2d148e83 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:07.968375 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f6120e94-7b49-4f18-b496-028e2d148e83 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:08.096939 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-f6120e94-7b49-4f18-b496-028e2d148e83 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:08.104595 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-f6120e94-7b49-4f18-b496-028e2d148e83 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 200 len: 1578 microversion: 2.1 time: 0.149226 Oct 03 14:58:08.105177 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 312/656] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:07 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 1578 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:08.774686 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-ebf29de4-da0d-4bb0-8c8b-9a378878e412 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:08.775389 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-ebf29de4-da0d-4bb0-8c8b-9a378878e412 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 78499c1b-6aff-4bab-8bc4-495a949e3637] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:08.782204 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ebf29de4-da0d-4bb0-8c8b-9a378878e412 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:08.782695 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ebf29de4-da0d-4bb0-8c8b-9a378878e412 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:08.783136 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ebf29de4-da0d-4bb0-8c8b-9a378878e412 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:08.783989 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ebf29de4-da0d-4bb0-8c8b-9a378878e412 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:08.784453 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ebf29de4-da0d-4bb0-8c8b-9a378878e412 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:08.784882 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ebf29de4-da0d-4bb0-8c8b-9a378878e412 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:08.910547 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-ebf29de4-da0d-4bb0-8c8b-9a378878e412 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:08.918101 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-ebf29de4-da0d-4bb0-8c8b-9a378878e412 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637" status: 200 len: 1366 microversion: 2.1 time: 0.147666 Oct 03 14:58:08.918654 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 345/657] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:08 2022] GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:09.129212 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-df51e325-2a97-4ad6-83f5-7ad91a0a021b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:09.129782 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-df51e325-2a97-4ad6-83f5-7ad91a0a021b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:09.136117 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-df51e325-2a97-4ad6-83f5-7ad91a0a021b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:09.136600 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-df51e325-2a97-4ad6-83f5-7ad91a0a021b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:09.137039 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-df51e325-2a97-4ad6-83f5-7ad91a0a021b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:09.137752 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-df51e325-2a97-4ad6-83f5-7ad91a0a021b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:09.138211 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-df51e325-2a97-4ad6-83f5-7ad91a0a021b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:09.138638 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-df51e325-2a97-4ad6-83f5-7ad91a0a021b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:09.266917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-df51e325-2a97-4ad6-83f5-7ad91a0a021b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:09.274464 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-df51e325-2a97-4ad6-83f5-7ad91a0a021b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 200 len: 1578 microversion: 2.1 time: 0.149132 Oct 03 14:58:09.275023 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 313/658] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:09 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 1578 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:09.611582 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-cdb676a6-f7f4-4128-95e8-fc14d25f9ba7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:09.612121 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-cdb676a6-f7f4-4128-95e8-fc14d25f9ba7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:09.618019 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cdb676a6-f7f4-4128-95e8-fc14d25f9ba7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:09.618502 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cdb676a6-f7f4-4128-95e8-fc14d25f9ba7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:09.618939 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cdb676a6-f7f4-4128-95e8-fc14d25f9ba7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:09.619621 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cdb676a6-f7f4-4128-95e8-fc14d25f9ba7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:09.620073 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cdb676a6-f7f4-4128-95e8-fc14d25f9ba7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:09.620494 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cdb676a6-f7f4-4128-95e8-fc14d25f9ba7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:09.699418 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.objects.instance [None req-cdb676a6-f7f4-4128-95e8-fc14d25f9ba7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lazy-loading 'services' on Instance uuid bac89fd1-5f09-42a7-90f2-5074c12859fc {{(pid=126851) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:58:09.770437 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-cdb676a6-f7f4-4128-95e8-fc14d25f9ba7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "DELETE /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc/os-volume_attachments/26524262-bab4-4557-b5db-0adf09b50258" status: 202 len: 0 microversion: 2.1 time: 0.258585 Oct 03 14:58:09.770939 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 346/659] 10.222.0.46 () {58 vars in 1416 bytes} [Mon Oct 3 14:58:09 2022] DELETE /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc/os-volume_attachments/26524262-bab4-4557-b5db-0adf09b50258 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:58:09.939931 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-d3099093-437a-4d94-a070-52f09632c294 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:09.940630 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-d3099093-437a-4d94-a070-52f09632c294 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 78499c1b-6aff-4bab-8bc4-495a949e3637] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:09.946636 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d3099093-437a-4d94-a070-52f09632c294 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:09.947120 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d3099093-437a-4d94-a070-52f09632c294 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:09.947555 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d3099093-437a-4d94-a070-52f09632c294 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:09.948245 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d3099093-437a-4d94-a070-52f09632c294 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:09.948781 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d3099093-437a-4d94-a070-52f09632c294 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:09.949206 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d3099093-437a-4d94-a070-52f09632c294 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:09.967298 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:58:10.178982 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-d3099093-437a-4d94-a070-52f09632c294 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:10.186578 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-d3099093-437a-4d94-a070-52f09632c294 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637" status: 200 len: 1366 microversion: 2.1 time: 0.250351 Oct 03 14:58:10.187153 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 314/660] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:09 2022] GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637 => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:10.300295 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-a4a3f909-fc63-47ba-b253-84dc109b6203 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:10.300998 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-a4a3f909-fc63-47ba-b253-84dc109b6203 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:10.307010 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a4a3f909-fc63-47ba-b253-84dc109b6203 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:10.307494 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a4a3f909-fc63-47ba-b253-84dc109b6203 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:10.307926 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a4a3f909-fc63-47ba-b253-84dc109b6203 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:10.308616 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a4a3f909-fc63-47ba-b253-84dc109b6203 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:10.309073 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a4a3f909-fc63-47ba-b253-84dc109b6203 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:10.309515 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a4a3f909-fc63-47ba-b253-84dc109b6203 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:10.444295 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-a4a3f909-fc63-47ba-b253-84dc109b6203 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:10.446737 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:58:10.455245 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-a4a3f909-fc63-47ba-b253-84dc109b6203 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 200 len: 1578 microversion: 2.1 time: 0.159101 Oct 03 14:58:10.472790 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 347/661] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:10 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 1578 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:10.737624 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-4ca9f464-0c65-41a1-8dbc-808c713ed53b req-b19aff75-8db5-422b-9f6b-3fae0e9b216d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8565107e-de79-4c29-a92d-0dcc47cdaad4", "name": "network-vif-deleted", "tag": "844f2524-468f-4861-a833-34bb9a1e4138"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:58:10.746859 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-4ca9f464-0c65-41a1-8dbc-808c713ed53b req-b19aff75-8db5-422b-9f6b-3fae0e9b216d service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:10.747330 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-4ca9f464-0c65-41a1-8dbc-808c713ed53b req-b19aff75-8db5-422b-9f6b-3fae0e9b216d service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:10.747753 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-4ca9f464-0c65-41a1-8dbc-808c713ed53b req-b19aff75-8db5-422b-9f6b-3fae0e9b216d service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:10.759352 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-4ca9f464-0c65-41a1-8dbc-808c713ed53b req-b19aff75-8db5-422b-9f6b-3fae0e9b216d service nova] Creating event network-vif-deleted:844f2524-468f-4861-a833-34bb9a1e4138 for instance 8565107e-de79-4c29-a92d-0dcc47cdaad4 on hv-cinder-85987 Oct 03 14:58:10.764304 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-4ca9f464-0c65-41a1-8dbc-808c713ed53b req-b19aff75-8db5-422b-9f6b-3fae0e9b216d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030415 Oct 03 14:58:10.765580 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 315/662] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:58:11.209019 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-4c2db404-2b0d-4937-aa34-5e3310bb15c4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:11.210169 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-4c2db404-2b0d-4937-aa34-5e3310bb15c4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 78499c1b-6aff-4bab-8bc4-495a949e3637] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:11.217022 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4c2db404-2b0d-4937-aa34-5e3310bb15c4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:11.217532 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4c2db404-2b0d-4937-aa34-5e3310bb15c4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:11.218098 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4c2db404-2b0d-4937-aa34-5e3310bb15c4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:11.218813 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4c2db404-2b0d-4937-aa34-5e3310bb15c4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:11.219263 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4c2db404-2b0d-4937-aa34-5e3310bb15c4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:11.219867 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4c2db404-2b0d-4937-aa34-5e3310bb15c4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:11.361567 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-4c2db404-2b0d-4937-aa34-5e3310bb15c4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:11.369358 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-4c2db404-2b0d-4937-aa34-5e3310bb15c4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637" status: 200 len: 1556 microversion: 2.1 time: 0.164170 Oct 03 14:58:11.370781 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 348/663] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:11 2022] GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637 => generated 1556 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:11.394033 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-001b13ea-616f-4e9a-962b-1dadf5076108 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:11.395299 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-001b13ea-616f-4e9a-962b-1dadf5076108 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 78499c1b-6aff-4bab-8bc4-495a949e3637] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:11.402384 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-001b13ea-616f-4e9a-962b-1dadf5076108 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:11.402982 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-001b13ea-616f-4e9a-962b-1dadf5076108 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:11.403540 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-001b13ea-616f-4e9a-962b-1dadf5076108 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:11.404320 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-001b13ea-616f-4e9a-962b-1dadf5076108 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:11.404850 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-001b13ea-616f-4e9a-962b-1dadf5076108 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:11.406066 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-001b13ea-616f-4e9a-962b-1dadf5076108 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:11.479178 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-ab9d7810-0b65-44e0-9262-aaef459c71be tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:11.480375 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-ab9d7810-0b65-44e0-9262-aaef459c71be tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:11.488139 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ab9d7810-0b65-44e0-9262-aaef459c71be tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:11.488690 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ab9d7810-0b65-44e0-9262-aaef459c71be tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:11.490006 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ab9d7810-0b65-44e0-9262-aaef459c71be tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:11.490869 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ab9d7810-0b65-44e0-9262-aaef459c71be tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:11.491187 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-001b13ea-616f-4e9a-962b-1dadf5076108 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102301 Oct 03 14:58:11.491505 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ab9d7810-0b65-44e0-9262-aaef459c71be tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:11.491770 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 316/664] 10.222.0.46 () {58 vars in 1275 bytes} [Mon Oct 3 14:58:11 2022] GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:58:11.491947 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ab9d7810-0b65-44e0-9262-aaef459c71be tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:11.533478 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ab9d7810-0b65-44e0-9262-aaef459c71be tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:11.534500 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ab9d7810-0b65-44e0-9262-aaef459c71be tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:11.535440 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ab9d7810-0b65-44e0-9262-aaef459c71be tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:11.536530 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.objects.instance [None req-ab9d7810-0b65-44e0-9262-aaef459c71be tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lazy-loading 'fault' on Instance uuid 8565107e-de79-4c29-a92d-0dcc47cdaad4 {{(pid=126851) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:58:11.585182 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-ab9d7810-0b65-44e0-9262-aaef459c71be tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:11.593990 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-ab9d7810-0b65-44e0-9262-aaef459c71be tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 200 len: 1230 microversion: 2.1 time: 0.118659 Oct 03 14:58:11.594857 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 349/665] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:11 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 1230 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:58:11.954293 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-3d2840e9-4e6c-4c6a-8511-f9bbbb228fc9 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:58:11.960423 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3d2840e9-4e6c-4c6a-8511-f9bbbb228fc9 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:11.960902 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3d2840e9-4e6c-4c6a-8511-f9bbbb228fc9 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:11.961332 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3d2840e9-4e6c-4c6a-8511-f9bbbb228fc9 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:11.983403 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-3d2840e9-4e6c-4c6a-8511-f9bbbb228fc9 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Going to try to stop instance {{(pid=126852) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 03 14:58:12.025971 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-3d2840e9-4e6c-4c6a-8511-f9bbbb228fc9 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "POST /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc/action" status: 202 len: 0 microversion: 2.1 time: 0.075876 Oct 03 14:58:12.026586 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 317/666] 10.222.0.46 () {60 vars in 1278 bytes} [Mon Oct 3 14:58:11 2022] POST /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:58:12.035068 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-14658328-698b-4edc-a064-c495b5b5be7c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:12.035676 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-14658328-698b-4edc-a064-c495b5b5be7c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:12.041880 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-14658328-698b-4edc-a064-c495b5b5be7c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:12.042371 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-14658328-698b-4edc-a064-c495b5b5be7c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:12.042810 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-14658328-698b-4edc-a064-c495b5b5be7c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:12.043510 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-14658328-698b-4edc-a064-c495b5b5be7c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:12.043968 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-14658328-698b-4edc-a064-c495b5b5be7c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:12.044391 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-14658328-698b-4edc-a064-c495b5b5be7c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:12.179772 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-14658328-698b-4edc-a064-c495b5b5be7c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:12.189281 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-14658328-698b-4edc-a064-c495b5b5be7c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1673 microversion: 2.1 time: 0.157925 Oct 03 14:58:12.189929 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 350/667] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:12 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:12.617778 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-bb430c1f-c583-4a5a-9cd5-26f686d091f6 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:12.618505 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-bb430c1f-c583-4a5a-9cd5-26f686d091f6 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:12.625578 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bb430c1f-c583-4a5a-9cd5-26f686d091f6 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:12.626065 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bb430c1f-c583-4a5a-9cd5-26f686d091f6 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:12.626496 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bb430c1f-c583-4a5a-9cd5-26f686d091f6 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:12.627191 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bb430c1f-c583-4a5a-9cd5-26f686d091f6 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:12.627641 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bb430c1f-c583-4a5a-9cd5-26f686d091f6 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:12.628062 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bb430c1f-c583-4a5a-9cd5-26f686d091f6 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:12.642959 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.wsgi [None req-bb430c1f-c583-4a5a-9cd5-26f686d091f6 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] HTTP exception thrown: Instance 8565107e-de79-4c29-a92d-0dcc47cdaad4 could not be found. Oct 03 14:58:12.644620 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-bb430c1f-c583-4a5a-9cd5-26f686d091f6 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Request method failure captured: Oct 03 14:58:12.644620 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: request: GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 HTTP/1.1 Oct 03 14:58:12.644620 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept: application/json Oct 03 14:58:12.644620 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept-Encoding: identity Oct 03 14:58:12.644620 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Connection: close Oct 03 14:58:12.644620 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Length: 0 Oct 03 14:58:12.644620 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Type: application/json Oct 03 14:58:12.644620 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Host: 10.222.0.46 Oct 03 14:58:12.644620 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Openstack-System-Scope: None Oct 03 14:58:12.644620 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: User-Agent: python-urllib3/1.26.12 Oct 03 14:58:12.644620 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Auth-Token: gAAAAABjOvd_yfAMSPgbV_kqotbDRVM2bCx_MDpkfYn5lsgwSFYcN_6tnSV2gCAgCwxu-iL9vJf4cUuc27NUI4hTi_Fsn1J-iCVAmsske7UG4YSVz-RvyNq6-yuRtVIa7kMQ3Jg_tOd8Mlk1IaICYmSMTKqNUoc8UIHo2lph8JfYw-zqfQPT5jU Oct 03 14:58:12.644620 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Id: None Oct 03 14:58:12.644620 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Name: None Oct 03 14:58:12.644620 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Identity-Status: Confirmed Oct 03 14:58:12.644620 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Is-Admin-Project: True Oct 03 14:58:12.644620 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Id: default Oct 03 14:58:12.644620 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Name: Default Oct 03 14:58:12.644620 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Id: a167b2ccacbc4e6d903b09d9a00650fe Oct 03 14:58:12.644620 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Name: tempest-TestVolumeBootPattern-264473187 Oct 03 14:58:12.644620 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Role: member,reader Oct 03 14:58:12.644620 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Roles: member,reader Oct 03 14:58:12.645984 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a167b2ccacbc4e6d903b09d9a00650fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a167b2ccacbc4e6d903b09d9a00650fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a167b2ccacbc4e6d903b09d9a00650fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a167b2ccacbc4e6d903b09d9a00650fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 14:58:12.645984 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant: tempest-TestVolumeBootPattern-264473187 Oct 03 14:58:12.645984 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Id: a167b2ccacbc4e6d903b09d9a00650fe Oct 03 14:58:12.645984 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Name: tempest-TestVolumeBootPattern-264473187 Oct 03 14:58:12.645984 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User: tempest-TestVolumeBootPattern-264473187-project Oct 03 14:58:12.645984 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Id: default Oct 03 14:58:12.645984 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Name: Default Oct 03 14:58:12.645984 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Id: 7cfae014351641d8a949775875a45958 Oct 03 14:58:12.645984 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Name: tempest-TestVolumeBootPattern-264473187-project Oct 03 14:58:12.645984 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: method: > Oct 03 14:58:12.645984 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: exception: Instance 8565107e-de79-4c29-a92d-0dcc47cdaad4 could not be found. Oct 03 14:58:12.645984 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: action_args: {'id': '8565107e-de79-4c29-a92d-0dcc47cdaad4'} Oct 03 14:58:12.646757 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:58:12.646757 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:12.646757 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:58:12.646757 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:58:12.646757 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:58:12.646757 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:58:12.646757 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:58:12.646757 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:58:12.646757 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:58:12.646757 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:58:12.646757 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8565107e-de79-4c29-a92d-0dcc47cdaad4 could not be found. Oct 03 14:58:12.646757 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:58:12.646757 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:58:12.646757 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:58:12.646757 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:12.646757 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:58:12.646757 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:58:12.646757 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:58:12.646757 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:58:12.646757 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:58:12.647951 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:58:12.647951 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:58:12.647951 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:58:12.647951 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:58:12.647951 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:58:12.647951 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:58:12.647951 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:58:12.647951 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8565107e-de79-4c29-a92d-0dcc47cdaad4 could not be found. Oct 03 14:58:12.647951 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:58:12.647951 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:58:12.647951 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:58:12.647951 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:12.647951 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:58:12.647951 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:58:12.647951 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:58:12.647951 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:58:12.647951 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8565107e-de79-4c29-a92d-0dcc47cdaad4 could not be found. Oct 03 14:58:12.647951 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:58:12.650154 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-bb430c1f-c583-4a5a-9cd5-26f686d091f6 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Returning 404 to user: Instance 8565107e-de79-4c29-a92d-0dcc47cdaad4 could not be found. {{(pid=126852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:58:12.650154 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-bb430c1f-c583-4a5a-9cd5-26f686d091f6 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 404 len: 111 microversion: 2.1 time: 0.032485 Oct 03 14:58:12.650154 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 318/668] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:12 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:58:12.779757 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-3cc2a1c8-2a70-4148-8bf9-df3480ae9c5c req-ee8935ce-0345-451e-afca-4183b1602c3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78499c1b-6aff-4bab-8bc4-495a949e3637", "tag": "328cb0d5-d75b-4a12-a5bf-4bf57d2686b1"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:58:12.789982 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-3cc2a1c8-2a70-4148-8bf9-df3480ae9c5c req-ee8935ce-0345-451e-afca-4183b1602c3b service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:12.790554 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-3cc2a1c8-2a70-4148-8bf9-df3480ae9c5c req-ee8935ce-0345-451e-afca-4183b1602c3b service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:12.791094 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-3cc2a1c8-2a70-4148-8bf9-df3480ae9c5c req-ee8935ce-0345-451e-afca-4183b1602c3b service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:12.805457 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-970fb892-16b2-43e4-974e-97367e769f45 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-733170393", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-296655480", "security_groups": [{"name": "tempest-secgroup-smoke-2061145357"}], "block_device_mapping_v2": [{"uuid": "ccdfcf73-f64e-4af1-ba8e-6d96b819af2b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3cf2f742-adf1-4aae-8244-1e9578ee60b2"}]}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:58:12.808454 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-3cc2a1c8-2a70-4148-8bf9-df3480ae9c5c req-ee8935ce-0345-451e-afca-4183b1602c3b service nova] Creating event network-changed:328cb0d5-d75b-4a12-a5bf-4bf57d2686b1 for instance 78499c1b-6aff-4bab-8bc4-495a949e3637 on hv-cinder-85987 Oct 03 14:58:12.813856 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-3cc2a1c8-2a70-4148-8bf9-df3480ae9c5c req-ee8935ce-0345-451e-afca-4183b1602c3b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037688 Oct 03 14:58:12.814597 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 351/669] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:58:12.976007 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.network.neutron [None req-970fb892-16b2-43e4-974e-97367e769f45 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] validate_networks() for [('3cf2f742-adf1-4aae-8244-1e9578ee60b2', None, None, None, None, None)] {{(pid=126852) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:58:13.212814 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-a14f091b-10c7-4018-94d1-8247c9551b9c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:13.213820 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-a14f091b-10c7-4018-94d1-8247c9551b9c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:13.238144 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a14f091b-10c7-4018-94d1-8247c9551b9c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:13.242292 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a14f091b-10c7-4018-94d1-8247c9551b9c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:13.242809 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a14f091b-10c7-4018-94d1-8247c9551b9c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:13.243555 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a14f091b-10c7-4018-94d1-8247c9551b9c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:13.244027 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a14f091b-10c7-4018-94d1-8247c9551b9c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:13.244454 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a14f091b-10c7-4018-94d1-8247c9551b9c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:13.393042 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-a14f091b-10c7-4018-94d1-8247c9551b9c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:13.400872 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-a14f091b-10c7-4018-94d1-8247c9551b9c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1673 microversion: 2.1 time: 0.192471 Oct 03 14:58:13.401442 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 352/670] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:13 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1673 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:58:13.930483 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-970fb892-16b2-43e4-974e-97367e769f45 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Flavor limits 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:58:13.930948 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-970fb892-16b2-43e4-974e-97367e769f45 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Image limits 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:58:13.931369 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-970fb892-16b2-43e4-974e-97367e769f45 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Flavor pref 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:58:13.931778 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-970fb892-16b2-43e4-974e-97367e769f45 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Image pref 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:58:13.932191 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-970fb892-16b2-43e4-974e-97367e769f45 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:58:13.941186 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-970fb892-16b2-43e4-974e-97367e769f45 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:13.941715 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-970fb892-16b2-43e4-974e-97367e769f45 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:13.942154 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-970fb892-16b2-43e4-974e-97367e769f45 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:13.943499 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-970fb892-16b2-43e4-974e-97367e769f45 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:13.943966 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-970fb892-16b2-43e4-974e-97367e769f45 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:13.944581 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-970fb892-16b2-43e4-974e-97367e769f45 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:13.962303 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-970fb892-16b2-43e4-974e-97367e769f45 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Getting quotas for project a167b2ccacbc4e6d903b09d9a00650fe. Resources: {'ram', 'instances', 'cores'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:58:13.966218 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-970fb892-16b2-43e4-974e-97367e769f45 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Getting quotas for user 7cfae014351641d8a949775875a45958 and project a167b2ccacbc4e6d903b09d9a00650fe. Resources: {'ram', 'instances', 'cores'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:58:14.022729 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-970fb892-16b2-43e4-974e-97367e769f45 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Going to run 1 instances... {{(pid=126852) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:58:14.024870 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-970fb892-16b2-43e4-974e-97367e769f45 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 1923d108-de98-422f-a3af-85b5bd792b35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ccdfcf73-f64e-4af1-ba8e-6d96b819af2b',volume_size=None,volume_type=None)] {{(pid=126852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:58:14.150447 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR oslo.messaging._drivers.impl_rabbit [None req-970fb892-16b2-43e4-974e-97367e769f45 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [21ca65e6-5af5-4824-af44-dcd4835fd6f9] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 14:58:14.424065 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-3c605d23-11a9-4342-b45e-3aa77a60e2e7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:14.424672 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-3c605d23-11a9-4342-b45e-3aa77a60e2e7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:14.431080 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3c605d23-11a9-4342-b45e-3aa77a60e2e7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:14.431556 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3c605d23-11a9-4342-b45e-3aa77a60e2e7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:14.431986 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3c605d23-11a9-4342-b45e-3aa77a60e2e7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:14.432664 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3c605d23-11a9-4342-b45e-3aa77a60e2e7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:14.433116 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3c605d23-11a9-4342-b45e-3aa77a60e2e7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:14.433555 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3c605d23-11a9-4342-b45e-3aa77a60e2e7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:14.561813 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-3c605d23-11a9-4342-b45e-3aa77a60e2e7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:14.569591 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-3c605d23-11a9-4342-b45e-3aa77a60e2e7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1673 microversion: 2.1 time: 0.149283 Oct 03 14:58:14.570163 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 353/671] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:14 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:58:15.158011 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO oslo.messaging._drivers.impl_rabbit [None req-970fb892-16b2-43e4-974e-97367e769f45 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [21ca65e6-5af5-4824-af44-dcd4835fd6f9] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 39810. Oct 03 14:58:15.161954 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-970fb892-16b2-43e4-974e-97367e769f45 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.360438 Oct 03 14:58:15.162593 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 319/672] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 3 14:58:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 2362 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 14:58:15.174354 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-13e9b2fd-e332-424e-8fd3-7d1d3fc1bb4d tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:15.174962 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-13e9b2fd-e332-424e-8fd3-7d1d3fc1bb4d tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 1923d108-de98-422f-a3af-85b5bd792b35] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:15.227432 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-13e9b2fd-e332-424e-8fd3-7d1d3fc1bb4d tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:15.234717 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-13e9b2fd-e332-424e-8fd3-7d1d3fc1bb4d tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35" status: 200 len: 1093 microversion: 2.1 time: 0.064828 Oct 03 14:58:15.235463 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 354/673] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:15 2022] GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35 => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:15.594080 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-1d181479-f060-42c5-9ca8-886f79f81713 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:15.594698 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-1d181479-f060-42c5-9ca8-886f79f81713 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:15.600840 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1d181479-f060-42c5-9ca8-886f79f81713 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:15.601336 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1d181479-f060-42c5-9ca8-886f79f81713 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:15.601804 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1d181479-f060-42c5-9ca8-886f79f81713 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:15.602507 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1d181479-f060-42c5-9ca8-886f79f81713 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:15.602971 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1d181479-f060-42c5-9ca8-886f79f81713 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:15.603399 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1d181479-f060-42c5-9ca8-886f79f81713 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:15.737015 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-1d181479-f060-42c5-9ca8-886f79f81713 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:15.745086 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-1d181479-f060-42c5-9ca8-886f79f81713 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1673 microversion: 2.1 time: 0.155729 Oct 03 14:58:15.745791 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 320/674] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:15 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:16.257272 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-77fce300-452c-40f7-86d8-d75ef119d23a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:16.257851 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-77fce300-452c-40f7-86d8-d75ef119d23a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 1923d108-de98-422f-a3af-85b5bd792b35] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:16.265261 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-77fce300-452c-40f7-86d8-d75ef119d23a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:16.265784 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-77fce300-452c-40f7-86d8-d75ef119d23a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:16.266216 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-77fce300-452c-40f7-86d8-d75ef119d23a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:16.266916 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-77fce300-452c-40f7-86d8-d75ef119d23a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:16.267365 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-77fce300-452c-40f7-86d8-d75ef119d23a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:16.267780 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-77fce300-452c-40f7-86d8-d75ef119d23a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:16.330137 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-77fce300-452c-40f7-86d8-d75ef119d23a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:16.337947 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-77fce300-452c-40f7-86d8-d75ef119d23a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35" status: 200 len: 1191 microversion: 2.1 time: 0.084505 Oct 03 14:58:16.338518 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 355/675] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:16 2022] GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35 => generated 1191 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:16.768883 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-929df9b0-f068-43dd-82f2-d2db8b04a051 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:16.769541 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-929df9b0-f068-43dd-82f2-d2db8b04a051 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:16.775839 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-929df9b0-f068-43dd-82f2-d2db8b04a051 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:16.776326 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-929df9b0-f068-43dd-82f2-d2db8b04a051 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:16.776761 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-929df9b0-f068-43dd-82f2-d2db8b04a051 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:16.777451 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-929df9b0-f068-43dd-82f2-d2db8b04a051 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:16.777952 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-929df9b0-f068-43dd-82f2-d2db8b04a051 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:16.778375 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-929df9b0-f068-43dd-82f2-d2db8b04a051 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:16.994622 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-929df9b0-f068-43dd-82f2-d2db8b04a051 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:17.003484 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-929df9b0-f068-43dd-82f2-d2db8b04a051 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1673 microversion: 2.1 time: 0.239220 Oct 03 14:58:17.004066 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 321/676] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:16 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1673 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:17.362989 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-8c666809-d8a8-4c97-9265-11fe33e8381e tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:17.364436 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-8c666809-d8a8-4c97-9265-11fe33e8381e tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 1923d108-de98-422f-a3af-85b5bd792b35] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:17.372135 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8c666809-d8a8-4c97-9265-11fe33e8381e tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:17.372641 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8c666809-d8a8-4c97-9265-11fe33e8381e tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:17.373181 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8c666809-d8a8-4c97-9265-11fe33e8381e tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:17.375113 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8c666809-d8a8-4c97-9265-11fe33e8381e tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:17.375709 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8c666809-d8a8-4c97-9265-11fe33e8381e tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:17.377177 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8c666809-d8a8-4c97-9265-11fe33e8381e tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:17.528144 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-8c666809-d8a8-4c97-9265-11fe33e8381e tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:17.537783 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-8c666809-d8a8-4c97-9265-11fe33e8381e tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35" status: 200 len: 1277 microversion: 2.1 time: 0.181236 Oct 03 14:58:17.538355 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 356/677] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:17 2022] GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35 => generated 1277 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:17.999368 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-8a7f1e3b-cfbc-4a98-b9d6-24827c479faa req-2e831ee7-b5a8-42f5-9e03-2638bab221fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1923d108-de98-422f-a3af-85b5bd792b35", "tag": "96b0cff0-5314-4971-92cf-71b39981d342"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:58:18.005047 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:58:18.013286 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-8a7f1e3b-cfbc-4a98-b9d6-24827c479faa req-2e831ee7-b5a8-42f5-9e03-2638bab221fa service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:18.013786 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-8a7f1e3b-cfbc-4a98-b9d6-24827c479faa req-2e831ee7-b5a8-42f5-9e03-2638bab221fa service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:18.014745 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-8a7f1e3b-cfbc-4a98-b9d6-24827c479faa req-2e831ee7-b5a8-42f5-9e03-2638bab221fa service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:18.026902 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-8a7f1e3b-cfbc-4a98-b9d6-24827c479faa req-2e831ee7-b5a8-42f5-9e03-2638bab221fa service nova] Creating event network-changed:96b0cff0-5314-4971-92cf-71b39981d342 for instance 1923d108-de98-422f-a3af-85b5bd792b35 on hv-cinder-85987 Oct 03 14:58:18.028200 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-18c226ff-a723-4c68-b023-262bb564c306 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:18.028842 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-18c226ff-a723-4c68-b023-262bb564c306 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:18.032302 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-8a7f1e3b-cfbc-4a98-b9d6-24827c479faa req-2e831ee7-b5a8-42f5-9e03-2638bab221fa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037408 Oct 03 14:58:18.032909 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 322/678] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:58:18.037016 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-18c226ff-a723-4c68-b023-262bb564c306 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:18.037976 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-18c226ff-a723-4c68-b023-262bb564c306 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:18.038418 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-18c226ff-a723-4c68-b023-262bb564c306 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:18.039124 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-18c226ff-a723-4c68-b023-262bb564c306 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:18.039600 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-18c226ff-a723-4c68-b023-262bb564c306 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:18.040010 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-18c226ff-a723-4c68-b023-262bb564c306 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:18.176469 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-18c226ff-a723-4c68-b023-262bb564c306 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:18.184395 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-18c226ff-a723-4c68-b023-262bb564c306 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1673 microversion: 2.1 time: 0.160396 Oct 03 14:58:18.185156 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 357/679] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:18 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:58:18.562310 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-37cf6d37-526f-4d79-8e5d-d10d2c6f376e tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:18.562996 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-37cf6d37-526f-4d79-8e5d-d10d2c6f376e tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 1923d108-de98-422f-a3af-85b5bd792b35] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:18.569961 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-37cf6d37-526f-4d79-8e5d-d10d2c6f376e tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:18.570441 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-37cf6d37-526f-4d79-8e5d-d10d2c6f376e tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:18.570873 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-37cf6d37-526f-4d79-8e5d-d10d2c6f376e tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:18.571555 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-37cf6d37-526f-4d79-8e5d-d10d2c6f376e tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:18.572007 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-37cf6d37-526f-4d79-8e5d-d10d2c6f376e tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:18.572429 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-37cf6d37-526f-4d79-8e5d-d10d2c6f376e tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:18.703141 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-37cf6d37-526f-4d79-8e5d-d10d2c6f376e tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:18.711093 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-37cf6d37-526f-4d79-8e5d-d10d2c6f376e tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35" status: 200 len: 1265 microversion: 2.1 time: 0.153682 Oct 03 14:58:18.712407 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 323/680] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:18 2022] GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:19.207080 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-9702308e-d364-452b-b207-d0e0bd8c0e4d tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:19.207695 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-9702308e-d364-452b-b207-d0e0bd8c0e4d tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:19.214373 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9702308e-d364-452b-b207-d0e0bd8c0e4d tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:19.214882 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9702308e-d364-452b-b207-d0e0bd8c0e4d tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:19.215313 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9702308e-d364-452b-b207-d0e0bd8c0e4d tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:19.215993 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9702308e-d364-452b-b207-d0e0bd8c0e4d tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:19.216444 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9702308e-d364-452b-b207-d0e0bd8c0e4d tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:19.216863 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9702308e-d364-452b-b207-d0e0bd8c0e4d tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:19.341817 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-9702308e-d364-452b-b207-d0e0bd8c0e4d tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:19.349965 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-9702308e-d364-452b-b207-d0e0bd8c0e4d tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1673 microversion: 2.1 time: 0.146660 Oct 03 14:58:19.350528 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 358/681] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:19 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:19.734712 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-6cbcf5f0-6d74-48cf-9430-a01ec681d65b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:19.735363 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-6cbcf5f0-6d74-48cf-9430-a01ec681d65b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 1923d108-de98-422f-a3af-85b5bd792b35] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:19.741935 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6cbcf5f0-6d74-48cf-9430-a01ec681d65b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:19.742425 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6cbcf5f0-6d74-48cf-9430-a01ec681d65b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:19.742867 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6cbcf5f0-6d74-48cf-9430-a01ec681d65b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:19.743597 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6cbcf5f0-6d74-48cf-9430-a01ec681d65b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:19.744057 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6cbcf5f0-6d74-48cf-9430-a01ec681d65b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:19.744487 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6cbcf5f0-6d74-48cf-9430-a01ec681d65b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:19.952262 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-6cbcf5f0-6d74-48cf-9430-a01ec681d65b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:19.960186 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-6cbcf5f0-6d74-48cf-9430-a01ec681d65b tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35" status: 200 len: 1265 microversion: 2.1 time: 0.229140 Oct 03 14:58:19.960781 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 324/682] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:19 2022] GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35 => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:20.373095 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-93b49eff-4c51-4ddf-9e0a-fbf625b44ff7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:20.374227 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-93b49eff-4c51-4ddf-9e0a-fbf625b44ff7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:20.380815 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-93b49eff-4c51-4ddf-9e0a-fbf625b44ff7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:20.381299 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-93b49eff-4c51-4ddf-9e0a-fbf625b44ff7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:20.381755 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-93b49eff-4c51-4ddf-9e0a-fbf625b44ff7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:20.382444 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-93b49eff-4c51-4ddf-9e0a-fbf625b44ff7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:20.382895 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-93b49eff-4c51-4ddf-9e0a-fbf625b44ff7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:20.383342 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-93b49eff-4c51-4ddf-9e0a-fbf625b44ff7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:20.514614 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-ca18856d-7328-4f9e-9edd-ad90a699f1fb tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:20.515114 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-ca18856d-7328-4f9e-9edd-ad90a699f1fb tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:20.515371 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-93b49eff-4c51-4ddf-9e0a-fbf625b44ff7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:20.521067 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ca18856d-7328-4f9e-9edd-ad90a699f1fb tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:20.521591 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ca18856d-7328-4f9e-9edd-ad90a699f1fb tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:20.522024 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ca18856d-7328-4f9e-9edd-ad90a699f1fb tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:20.522711 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ca18856d-7328-4f9e-9edd-ad90a699f1fb tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:20.523015 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-93b49eff-4c51-4ddf-9e0a-fbf625b44ff7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1673 microversion: 2.1 time: 0.153777 Oct 03 14:58:20.523164 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ca18856d-7328-4f9e-9edd-ad90a699f1fb tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:20.523580 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 359/683] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:20 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:20.523716 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ca18856d-7328-4f9e-9edd-ad90a699f1fb tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:20.554891 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-ca18856d-7328-4f9e-9edd-ad90a699f1fb tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db/os-volume_attachments/f08eecab-5fea-4092-870a-4ad477cf1fc5" status: 200 len: 194 microversion: 2.20 time: 0.149208 Oct 03 14:58:20.555376 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 325/684] 10.222.0.46 () {60 vars in 1454 bytes} [Mon Oct 3 14:58:20 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db/os-volume_attachments/f08eecab-5fea-4092-870a-4ad477cf1fc5 => generated 194 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 14:58:20.622294 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-7a718009-75cd-4aa6-b867-bf7bcb4699fa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:20.622785 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-7a718009-75cd-4aa6-b867-bf7bcb4699fa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:20.629104 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7a718009-75cd-4aa6-b867-bf7bcb4699fa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:20.629621 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7a718009-75cd-4aa6-b867-bf7bcb4699fa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:20.630056 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7a718009-75cd-4aa6-b867-bf7bcb4699fa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:20.630750 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7a718009-75cd-4aa6-b867-bf7bcb4699fa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:20.631204 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7a718009-75cd-4aa6-b867-bf7bcb4699fa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:20.631629 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7a718009-75cd-4aa6-b867-bf7bcb4699fa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:20.716324 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.objects.instance [None req-7a718009-75cd-4aa6-b867-bf7bcb4699fa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lazy-loading 'services' on Instance uuid 27879d6c-62f5-4281-b134-faecf706a2db {{(pid=126851) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:58:20.787049 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-7a718009-75cd-4aa6-b867-bf7bcb4699fa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "DELETE /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db/os-volume_attachments/f08eecab-5fea-4092-870a-4ad477cf1fc5" status: 202 len: 0 microversion: 2.20 time: 0.168428 Oct 03 14:58:20.787706 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 360/685] 10.222.0.46 () {60 vars in 1457 bytes} [Mon Oct 3 14:58:20 2022] DELETE /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db/os-volume_attachments/f08eecab-5fea-4092-870a-4ad477cf1fc5 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:58:20.797351 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-2823c62e-9559-484e-986a-ca2988e6b03a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:20.799701 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-2823c62e-9559-484e-986a-ca2988e6b03a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:20.806510 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2823c62e-9559-484e-986a-ca2988e6b03a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:20.807164 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2823c62e-9559-484e-986a-ca2988e6b03a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:20.807684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2823c62e-9559-484e-986a-ca2988e6b03a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:20.808762 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2823c62e-9559-484e-986a-ca2988e6b03a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:20.809897 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2823c62e-9559-484e-986a-ca2988e6b03a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:20.810331 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2823c62e-9559-484e-986a-ca2988e6b03a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:20.841705 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-2823c62e-9559-484e-986a-ca2988e6b03a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048966 Oct 03 14:58:20.842267 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 326/686] 10.222.0.46 () {60 vars in 1343 bytes} [Mon Oct 3 14:58:20 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:58:20.984020 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-0fbd9774-08d8-4877-984e-a08f122417ff tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:20.984727 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-0fbd9774-08d8-4877-984e-a08f122417ff tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 1923d108-de98-422f-a3af-85b5bd792b35] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:20.991159 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0fbd9774-08d8-4877-984e-a08f122417ff tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:20.991647 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0fbd9774-08d8-4877-984e-a08f122417ff tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:20.992083 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0fbd9774-08d8-4877-984e-a08f122417ff tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:20.992774 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0fbd9774-08d8-4877-984e-a08f122417ff tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:20.993231 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0fbd9774-08d8-4877-984e-a08f122417ff tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:20.993697 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0fbd9774-08d8-4877-984e-a08f122417ff tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:21.125753 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-0fbd9774-08d8-4877-984e-a08f122417ff tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:21.133755 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-0fbd9774-08d8-4877-984e-a08f122417ff tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35" status: 200 len: 1265 microversion: 2.1 time: 0.154438 Oct 03 14:58:21.134315 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 361/687] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:20 2022] GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:21.546652 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-cd99a056-ff20-4ed7-b7fb-17e684aa903b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:21.547304 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-cd99a056-ff20-4ed7-b7fb-17e684aa903b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:21.553014 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cd99a056-ff20-4ed7-b7fb-17e684aa903b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:21.553509 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cd99a056-ff20-4ed7-b7fb-17e684aa903b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:21.553950 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cd99a056-ff20-4ed7-b7fb-17e684aa903b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:21.554634 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cd99a056-ff20-4ed7-b7fb-17e684aa903b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:21.555083 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cd99a056-ff20-4ed7-b7fb-17e684aa903b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:21.555502 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cd99a056-ff20-4ed7-b7fb-17e684aa903b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:21.685720 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-cd99a056-ff20-4ed7-b7fb-17e684aa903b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:21.693735 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-cd99a056-ff20-4ed7-b7fb-17e684aa903b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1673 microversion: 2.1 time: 0.151546 Oct 03 14:58:21.694454 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 327/688] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:21 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:21.854313 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-711d7520-a37d-49b3-b905-1f046feb82fe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:21.856415 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-711d7520-a37d-49b3-b905-1f046feb82fe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:21.862652 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-711d7520-a37d-49b3-b905-1f046feb82fe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:21.863127 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-711d7520-a37d-49b3-b905-1f046feb82fe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:21.863556 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-711d7520-a37d-49b3-b905-1f046feb82fe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:21.864233 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-711d7520-a37d-49b3-b905-1f046feb82fe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:21.864684 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-711d7520-a37d-49b3-b905-1f046feb82fe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:21.865101 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-711d7520-a37d-49b3-b905-1f046feb82fe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:21.894241 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-711d7520-a37d-49b3-b905-1f046feb82fe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043892 Oct 03 14:58:21.894791 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 362/689] 10.222.0.46 () {60 vars in 1343 bytes} [Mon Oct 3 14:58:21 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:58:22.156759 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-73e2f1bd-b1b2-445f-b76f-bc311903037e tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:22.157407 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-73e2f1bd-b1b2-445f-b76f-bc311903037e tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 1923d108-de98-422f-a3af-85b5bd792b35] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:22.163915 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-73e2f1bd-b1b2-445f-b76f-bc311903037e tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:22.164400 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-73e2f1bd-b1b2-445f-b76f-bc311903037e tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:22.164837 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-73e2f1bd-b1b2-445f-b76f-bc311903037e tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:22.165558 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-73e2f1bd-b1b2-445f-b76f-bc311903037e tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:22.166019 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-73e2f1bd-b1b2-445f-b76f-bc311903037e tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:22.166444 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-73e2f1bd-b1b2-445f-b76f-bc311903037e tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:22.293587 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-73e2f1bd-b1b2-445f-b76f-bc311903037e tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:22.301925 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-73e2f1bd-b1b2-445f-b76f-bc311903037e tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35" status: 200 len: 1265 microversion: 2.1 time: 0.148889 Oct 03 14:58:22.302492 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 328/690] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:22 2022] GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:22.716563 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-efcea9fa-b107-4477-9185-d02c16783835 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:22.717733 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-efcea9fa-b107-4477-9185-d02c16783835 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:22.723689 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-efcea9fa-b107-4477-9185-d02c16783835 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:22.724165 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-efcea9fa-b107-4477-9185-d02c16783835 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:22.724596 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-efcea9fa-b107-4477-9185-d02c16783835 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:22.725269 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-efcea9fa-b107-4477-9185-d02c16783835 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:22.725763 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-efcea9fa-b107-4477-9185-d02c16783835 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:22.726183 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-efcea9fa-b107-4477-9185-d02c16783835 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:22.854364 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-efcea9fa-b107-4477-9185-d02c16783835 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:22.863019 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-efcea9fa-b107-4477-9185-d02c16783835 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1650 microversion: 2.1 time: 0.150287 Oct 03 14:58:22.863589 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 363/691] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:22 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1650 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:22.885007 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-1a65cc93-bbd4-4462-9689-e0cc6abd56fa tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:58:22.890868 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1a65cc93-bbd4-4462-9689-e0cc6abd56fa tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:22.891356 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1a65cc93-bbd4-4462-9689-e0cc6abd56fa tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:22.891795 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1a65cc93-bbd4-4462-9689-e0cc6abd56fa tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:22.907137 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-2d971594-20fc-41a9-88e9-987a31b3ffae tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:22.909388 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-2d971594-20fc-41a9-88e9-987a31b3ffae tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:22.914273 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-1a65cc93-bbd4-4462-9689-e0cc6abd56fa tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Going to try to start instance {{(pid=126852) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 03 14:58:22.915249 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2d971594-20fc-41a9-88e9-987a31b3ffae tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:22.915734 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2d971594-20fc-41a9-88e9-987a31b3ffae tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:22.916167 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2d971594-20fc-41a9-88e9-987a31b3ffae tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:22.916856 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2d971594-20fc-41a9-88e9-987a31b3ffae tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:22.917314 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2d971594-20fc-41a9-88e9-987a31b3ffae tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:22.917768 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2d971594-20fc-41a9-88e9-987a31b3ffae tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:22.947406 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-2d971594-20fc-41a9-88e9-987a31b3ffae tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044467 Oct 03 14:58:22.947949 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 364/692] 10.222.0.46 () {60 vars in 1343 bytes} [Mon Oct 3 14:58:22 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:58:22.961352 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-1a65cc93-bbd4-4462-9689-e0cc6abd56fa tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "POST /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc/action" status: 202 len: 0 microversion: 2.1 time: 0.079951 Oct 03 14:58:22.965178 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 329/693] 10.222.0.46 () {60 vars in 1278 bytes} [Mon Oct 3 14:58:22 2022] POST /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:58:22.970805 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-b3a465a0-29e3-4a6d-9fa1-9b6ddd7b94e0 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:22.971524 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-b3a465a0-29e3-4a6d-9fa1-9b6ddd7b94e0 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:22.977456 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b3a465a0-29e3-4a6d-9fa1-9b6ddd7b94e0 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:22.977975 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b3a465a0-29e3-4a6d-9fa1-9b6ddd7b94e0 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:22.978406 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b3a465a0-29e3-4a6d-9fa1-9b6ddd7b94e0 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:22.979136 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b3a465a0-29e3-4a6d-9fa1-9b6ddd7b94e0 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:22.979589 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b3a465a0-29e3-4a6d-9fa1-9b6ddd7b94e0 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:22.980002 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b3a465a0-29e3-4a6d-9fa1-9b6ddd7b94e0 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:22.984819 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:58:23.024486 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-dbcbb89e-08bc-428f-9849-17495d41abd0 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:23.025161 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-dbcbb89e-08bc-428f-9849-17495d41abd0 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:23.032053 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-dbcbb89e-08bc-428f-9849-17495d41abd0 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:23.032688 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-dbcbb89e-08bc-428f-9849-17495d41abd0 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:23.033155 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-dbcbb89e-08bc-428f-9849-17495d41abd0 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:23.034101 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-dbcbb89e-08bc-428f-9849-17495d41abd0 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:23.034561 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-dbcbb89e-08bc-428f-9849-17495d41abd0 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:23.035001 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-dbcbb89e-08bc-428f-9849-17495d41abd0 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:23.060376 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-dbcbb89e-08bc-428f-9849-17495d41abd0 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Going to try to terminate instance {{(pid=126852) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:58:23.112971 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:58:23.113278 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-b3a465a0-29e3-4a6d-9fa1-9b6ddd7b94e0 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:23.122562 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-b3a465a0-29e3-4a6d-9fa1-9b6ddd7b94e0 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1659 microversion: 2.1 time: 0.155880 Oct 03 14:58:23.137586 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 365/694] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:22 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1659 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:58:23.148621 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-dbcbb89e-08bc-428f-9849-17495d41abd0 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "DELETE /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 204 len: 0 microversion: 2.20 time: 0.127899 Oct 03 14:58:23.149224 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 330/695] 10.222.0.46 () {60 vars in 1280 bytes} [Mon Oct 3 14:58:23 2022] DELETE /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 03 14:58:23.157995 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-5f73f752-0222-43c7-a0eb-c08d13492546 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:23.158642 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-5f73f752-0222-43c7-a0eb-c08d13492546 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:23.164897 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5f73f752-0222-43c7-a0eb-c08d13492546 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:23.165381 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5f73f752-0222-43c7-a0eb-c08d13492546 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:23.165915 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5f73f752-0222-43c7-a0eb-c08d13492546 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:23.166810 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5f73f752-0222-43c7-a0eb-c08d13492546 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:23.167351 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5f73f752-0222-43c7-a0eb-c08d13492546 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:23.167781 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5f73f752-0222-43c7-a0eb-c08d13492546 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:23.299436 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-5f73f752-0222-43c7-a0eb-c08d13492546 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:23.307388 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-5f73f752-0222-43c7-a0eb-c08d13492546 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:23.308799 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-5f73f752-0222-43c7-a0eb-c08d13492546 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:23.309953 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-5f73f752-0222-43c7-a0eb-c08d13492546 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1724 microversion: 2.20 time: 0.156352 Oct 03 14:58:23.310503 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 366/696] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:23 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:58:23.325787 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-3b15588e-c8de-4cfa-9f57-1ce72f3f0e5f tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:23.327078 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-3b15588e-c8de-4cfa-9f57-1ce72f3f0e5f tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 1923d108-de98-422f-a3af-85b5bd792b35] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:23.333388 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3b15588e-c8de-4cfa-9f57-1ce72f3f0e5f tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:23.333915 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3b15588e-c8de-4cfa-9f57-1ce72f3f0e5f tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:23.334347 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3b15588e-c8de-4cfa-9f57-1ce72f3f0e5f tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:23.335296 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3b15588e-c8de-4cfa-9f57-1ce72f3f0e5f tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:23.335745 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3b15588e-c8de-4cfa-9f57-1ce72f3f0e5f tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:23.336164 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3b15588e-c8de-4cfa-9f57-1ce72f3f0e5f tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:23.465762 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-3b15588e-c8de-4cfa-9f57-1ce72f3f0e5f tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:23.473311 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-3b15588e-c8de-4cfa-9f57-1ce72f3f0e5f tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35" status: 200 len: 1265 microversion: 2.1 time: 0.151728 Oct 03 14:58:23.473907 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 331/697] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:23 2022] GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:24.150426 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-a28a8f29-7ff8-498f-a795-8e975fc93cc2 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:24.150975 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-a28a8f29-7ff8-498f-a795-8e975fc93cc2 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:24.157797 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a28a8f29-7ff8-498f-a795-8e975fc93cc2 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:24.158273 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a28a8f29-7ff8-498f-a795-8e975fc93cc2 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:24.158705 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a28a8f29-7ff8-498f-a795-8e975fc93cc2 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:24.159384 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a28a8f29-7ff8-498f-a795-8e975fc93cc2 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:24.159832 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a28a8f29-7ff8-498f-a795-8e975fc93cc2 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:24.160245 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a28a8f29-7ff8-498f-a795-8e975fc93cc2 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:24.284999 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-a28a8f29-7ff8-498f-a795-8e975fc93cc2 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:24.292669 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-a28a8f29-7ff8-498f-a795-8e975fc93cc2 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1659 microversion: 2.1 time: 0.146185 Oct 03 14:58:24.293225 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 367/698] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:24 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1659 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:24.335219 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-56afd1fd-3f1e-4ce5-9234-f27d3fe3518e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:24.335864 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-56afd1fd-3f1e-4ce5-9234-f27d3fe3518e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:24.337842 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell0:SELECT=2 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:58:24.338506 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell0:SELECT=6 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:58:24.345747 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-56afd1fd-3f1e-4ce5-9234-f27d3fe3518e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:24.346238 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-56afd1fd-3f1e-4ce5-9234-f27d3fe3518e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:24.346684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-56afd1fd-3f1e-4ce5-9234-f27d3fe3518e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:24.347383 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-56afd1fd-3f1e-4ce5-9234-f27d3fe3518e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:24.347845 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-56afd1fd-3f1e-4ce5-9234-f27d3fe3518e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:24.348276 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-56afd1fd-3f1e-4ce5-9234-f27d3fe3518e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:24.471911 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-56afd1fd-3f1e-4ce5-9234-f27d3fe3518e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:24.480160 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-56afd1fd-3f1e-4ce5-9234-f27d3fe3518e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:24.481690 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-56afd1fd-3f1e-4ce5-9234-f27d3fe3518e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:24.482891 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-56afd1fd-3f1e-4ce5-9234-f27d3fe3518e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1724 microversion: 2.20 time: 0.151757 Oct 03 14:58:24.483448 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 332/699] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:24 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:58:24.495683 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-9640ddcd-f9e4-42dc-8b56-ab84ef7c35ab tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:24.496295 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-9640ddcd-f9e4-42dc-8b56-ab84ef7c35ab tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 1923d108-de98-422f-a3af-85b5bd792b35] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:24.502181 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9640ddcd-f9e4-42dc-8b56-ab84ef7c35ab tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:24.502669 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9640ddcd-f9e4-42dc-8b56-ab84ef7c35ab tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:24.503111 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9640ddcd-f9e4-42dc-8b56-ab84ef7c35ab tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:24.503818 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9640ddcd-f9e4-42dc-8b56-ab84ef7c35ab tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:24.504257 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9640ddcd-f9e4-42dc-8b56-ab84ef7c35ab tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:24.504684 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9640ddcd-f9e4-42dc-8b56-ab84ef7c35ab tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:24.629050 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-9640ddcd-f9e4-42dc-8b56-ab84ef7c35ab tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:24.636570 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-9640ddcd-f9e4-42dc-8b56-ab84ef7c35ab tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35" status: 200 len: 1265 microversion: 2.1 time: 0.144714 Oct 03 14:58:24.637135 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 368/700] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:24 2022] GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35 => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:25.316105 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-5a09d282-e159-436a-b085-d4250860e18a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:25.316709 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-5a09d282-e159-436a-b085-d4250860e18a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:25.322561 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5a09d282-e159-436a-b085-d4250860e18a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:25.323040 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5a09d282-e159-436a-b085-d4250860e18a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:25.323471 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5a09d282-e159-436a-b085-d4250860e18a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:25.324153 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5a09d282-e159-436a-b085-d4250860e18a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:25.324599 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5a09d282-e159-436a-b085-d4250860e18a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:25.325020 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5a09d282-e159-436a-b085-d4250860e18a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:25.450233 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-5a09d282-e159-436a-b085-d4250860e18a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:25.458305 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-5a09d282-e159-436a-b085-d4250860e18a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1659 microversion: 2.1 time: 0.146009 Oct 03 14:58:25.458862 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 333/701] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:25 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1659 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:25.508297 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-e799ddf7-5cec-478e-8623-4dbfa93da9d9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:25.508898 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-e799ddf7-5cec-478e-8623-4dbfa93da9d9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:25.511194 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell0:SELECT=2 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:58:25.517062 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e799ddf7-5cec-478e-8623-4dbfa93da9d9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:25.517559 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e799ddf7-5cec-478e-8623-4dbfa93da9d9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:25.518061 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e799ddf7-5cec-478e-8623-4dbfa93da9d9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:25.518742 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e799ddf7-5cec-478e-8623-4dbfa93da9d9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:25.519191 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e799ddf7-5cec-478e-8623-4dbfa93da9d9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:25.519605 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e799ddf7-5cec-478e-8623-4dbfa93da9d9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:25.648974 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-e799ddf7-5cec-478e-8623-4dbfa93da9d9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:25.656987 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-e799ddf7-5cec-478e-8623-4dbfa93da9d9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:25.658446 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-e799ddf7-5cec-478e-8623-4dbfa93da9d9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:25.659598 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-e799ddf7-5cec-478e-8623-4dbfa93da9d9 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1724 microversion: 2.20 time: 0.155169 Oct 03 14:58:25.659893 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-751a0297-f1e9-45cf-80df-911c4132256d tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:25.660307 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 369/702] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:25 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:58:25.660505 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-751a0297-f1e9-45cf-80df-911c4132256d tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 1923d108-de98-422f-a3af-85b5bd792b35] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:25.666343 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-751a0297-f1e9-45cf-80df-911c4132256d tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:25.666828 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-751a0297-f1e9-45cf-80df-911c4132256d tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:25.667265 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-751a0297-f1e9-45cf-80df-911c4132256d tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:25.667952 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-751a0297-f1e9-45cf-80df-911c4132256d tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:25.668403 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-751a0297-f1e9-45cf-80df-911c4132256d tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:25.668824 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-751a0297-f1e9-45cf-80df-911c4132256d tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:25.794722 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-751a0297-f1e9-45cf-80df-911c4132256d tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:25.802241 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-751a0297-f1e9-45cf-80df-911c4132256d tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35" status: 200 len: 1265 microversion: 2.1 time: 0.146112 Oct 03 14:58:25.802807 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 334/703] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:25 2022] GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:58:26.481119 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-fc564487-0169-427a-8c5e-7b486ab97739 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:26.481686 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-fc564487-0169-427a-8c5e-7b486ab97739 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:26.488063 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fc564487-0169-427a-8c5e-7b486ab97739 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:26.488543 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fc564487-0169-427a-8c5e-7b486ab97739 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:26.488972 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fc564487-0169-427a-8c5e-7b486ab97739 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:26.489859 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fc564487-0169-427a-8c5e-7b486ab97739 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:26.490309 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fc564487-0169-427a-8c5e-7b486ab97739 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:26.490724 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fc564487-0169-427a-8c5e-7b486ab97739 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:26.684300 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-5e81684c-1d9e-4b32-8c7c-2511b1382eee tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:26.684901 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-5e81684c-1d9e-4b32-8c7c-2511b1382eee tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:26.690985 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5e81684c-1d9e-4b32-8c7c-2511b1382eee tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:26.691467 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5e81684c-1d9e-4b32-8c7c-2511b1382eee tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:26.691897 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5e81684c-1d9e-4b32-8c7c-2511b1382eee tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:26.692592 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5e81684c-1d9e-4b32-8c7c-2511b1382eee tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:26.693043 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5e81684c-1d9e-4b32-8c7c-2511b1382eee tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:26.693811 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5e81684c-1d9e-4b32-8c7c-2511b1382eee tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:26.702250 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-fc564487-0169-427a-8c5e-7b486ab97739 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:26.710194 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-fc564487-0169-427a-8c5e-7b486ab97739 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1659 microversion: 2.1 time: 0.232483 Oct 03 14:58:26.711016 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 370/704] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:26 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1659 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:26.826413 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-cc6ed781-944d-40f1-83dc-817b189fcbef tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:26.827159 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-cc6ed781-944d-40f1-83dc-817b189fcbef tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 1923d108-de98-422f-a3af-85b5bd792b35] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:26.832015 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-5e81684c-1d9e-4b32-8c7c-2511b1382eee tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:26.835586 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cc6ed781-944d-40f1-83dc-817b189fcbef tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:26.836090 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cc6ed781-944d-40f1-83dc-817b189fcbef tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:26.836535 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cc6ed781-944d-40f1-83dc-817b189fcbef tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:26.837242 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cc6ed781-944d-40f1-83dc-817b189fcbef tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:26.837730 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cc6ed781-944d-40f1-83dc-817b189fcbef tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:26.838162 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cc6ed781-944d-40f1-83dc-817b189fcbef tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:26.841675 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-5e81684c-1d9e-4b32-8c7c-2511b1382eee tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:26.843171 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-5e81684c-1d9e-4b32-8c7c-2511b1382eee tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:26.844979 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-5e81684c-1d9e-4b32-8c7c-2511b1382eee tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1724 microversion: 2.20 time: 0.164597 Oct 03 14:58:26.853548 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 335/705] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:26 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:58:27.310996 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-cc6ed781-944d-40f1-83dc-817b189fcbef tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:27.319440 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-cc6ed781-944d-40f1-83dc-817b189fcbef tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35" status: 200 len: 1265 microversion: 2.1 time: 0.498206 Oct 03 14:58:27.320215 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 371/706] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:26 2022] GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35 => generated 1265 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:58:27.536422 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-1cf6512e-4ced-488e-95a7-9844637fc202 req-e899b24d-9cfc-4c6c-88e4-4603bde944e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27879d6c-62f5-4281-b134-faecf706a2db", "name": "network-vif-deleted", "tag": "abd33b94-cd03-47ad-bbbe-b38838da0555"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:58:27.559501 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-1cf6512e-4ced-488e-95a7-9844637fc202 req-e899b24d-9cfc-4c6c-88e4-4603bde944e7 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:27.560435 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-1cf6512e-4ced-488e-95a7-9844637fc202 req-e899b24d-9cfc-4c6c-88e4-4603bde944e7 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:27.560871 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-1cf6512e-4ced-488e-95a7-9844637fc202 req-e899b24d-9cfc-4c6c-88e4-4603bde944e7 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:27.574386 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-1cf6512e-4ced-488e-95a7-9844637fc202 req-e899b24d-9cfc-4c6c-88e4-4603bde944e7 service nova] Creating event network-vif-deleted:abd33b94-cd03-47ad-bbbe-b38838da0555 for instance 27879d6c-62f5-4281-b134-faecf706a2db on hv-cinder-85987 Oct 03 14:58:27.579989 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-1cf6512e-4ced-488e-95a7-9844637fc202 req-e899b24d-9cfc-4c6c-88e4-4603bde944e7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118860 Oct 03 14:58:27.580953 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 336/707] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:58:27.733155 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-48d63d15-e336-4a5b-b8f1-aebf98a1d750 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:27.734304 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-48d63d15-e336-4a5b-b8f1-aebf98a1d750 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:27.742844 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-48d63d15-e336-4a5b-b8f1-aebf98a1d750 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:27.743336 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-48d63d15-e336-4a5b-b8f1-aebf98a1d750 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:27.743771 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-48d63d15-e336-4a5b-b8f1-aebf98a1d750 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:27.744479 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-48d63d15-e336-4a5b-b8f1-aebf98a1d750 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:27.744936 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-48d63d15-e336-4a5b-b8f1-aebf98a1d750 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:27.745368 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-48d63d15-e336-4a5b-b8f1-aebf98a1d750 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:27.875318 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-6c18802c-1370-4c62-9e02-94aa333ae103 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:27.876609 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-6c18802c-1370-4c62-9e02-94aa333ae103 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:27.885488 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6c18802c-1370-4c62-9e02-94aa333ae103 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:27.886205 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6c18802c-1370-4c62-9e02-94aa333ae103 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:27.886706 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6c18802c-1370-4c62-9e02-94aa333ae103 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:27.887475 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6c18802c-1370-4c62-9e02-94aa333ae103 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:27.887993 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6c18802c-1370-4c62-9e02-94aa333ae103 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:27.889437 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6c18802c-1370-4c62-9e02-94aa333ae103 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:27.911597 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-48d63d15-e336-4a5b-b8f1-aebf98a1d750 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:27.919440 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-48d63d15-e336-4a5b-b8f1-aebf98a1d750 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1663 microversion: 2.1 time: 0.190117 Oct 03 14:58:27.921031 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 372/708] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:27 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1663 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:27.931906 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6c18802c-1370-4c62-9e02-94aa333ae103 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:27.932330 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6c18802c-1370-4c62-9e02-94aa333ae103 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:27.932773 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6c18802c-1370-4c62-9e02-94aa333ae103 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:27.933221 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.objects.instance [None req-6c18802c-1370-4c62-9e02-94aa333ae103 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lazy-loading 'fault' on Instance uuid 27879d6c-62f5-4281-b134-faecf706a2db {{(pid=126852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:58:27.981435 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-6c18802c-1370-4c62-9e02-94aa333ae103 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:27.990409 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-6c18802c-1370-4c62-9e02-94aa333ae103 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:27.991894 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-6c18802c-1370-4c62-9e02-94aa333ae103 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:27.993065 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-6c18802c-1370-4c62-9e02-94aa333ae103 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 200 len: 1371 microversion: 2.20 time: 0.126241 Oct 03 14:58:27.993841 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 337/709] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:27 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 1371 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:58:28.343162 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-f1189c58-3a39-422c-a5c7-1744ee753dd8 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:28.344330 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-f1189c58-3a39-422c-a5c7-1744ee753dd8 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 1923d108-de98-422f-a3af-85b5bd792b35] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:28.350431 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f1189c58-3a39-422c-a5c7-1744ee753dd8 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:28.350913 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f1189c58-3a39-422c-a5c7-1744ee753dd8 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:28.351352 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f1189c58-3a39-422c-a5c7-1744ee753dd8 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:28.352038 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f1189c58-3a39-422c-a5c7-1744ee753dd8 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:28.352493 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f1189c58-3a39-422c-a5c7-1744ee753dd8 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:28.352918 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f1189c58-3a39-422c-a5c7-1744ee753dd8 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:28.490661 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-f1189c58-3a39-422c-a5c7-1744ee753dd8 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:28.498608 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-f1189c58-3a39-422c-a5c7-1744ee753dd8 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35" status: 200 len: 1265 microversion: 2.1 time: 0.159297 Oct 03 14:58:28.499195 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 373/710] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:28 2022] GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:29.017691 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-00c473ef-3db6-4430-811c-49d7441f3800 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:29.018241 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-00c473ef-3db6-4430-811c-49d7441f3800 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:29.024448 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-00c473ef-3db6-4430-811c-49d7441f3800 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:29.024930 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-00c473ef-3db6-4430-811c-49d7441f3800 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:29.025361 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-00c473ef-3db6-4430-811c-49d7441f3800 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:29.026079 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-00c473ef-3db6-4430-811c-49d7441f3800 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:29.026533 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-00c473ef-3db6-4430-811c-49d7441f3800 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:29.026956 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-00c473ef-3db6-4430-811c-49d7441f3800 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:29.039847 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.wsgi [None req-00c473ef-3db6-4430-811c-49d7441f3800 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] HTTP exception thrown: Instance 27879d6c-62f5-4281-b134-faecf706a2db could not be found. Oct 03 14:58:29.041445 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-00c473ef-3db6-4430-811c-49d7441f3800 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Request method failure captured: Oct 03 14:58:29.041445 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: request: GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db HTTP/1.1 Oct 03 14:58:29.041445 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept: application/json Oct 03 14:58:29.041445 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept-Encoding: identity Oct 03 14:58:29.041445 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Connection: close Oct 03 14:58:29.041445 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Length: 0 Oct 03 14:58:29.041445 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Type: application/json Oct 03 14:58:29.041445 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Host: 10.222.0.46 Oct 03 14:58:29.041445 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Openstack-System-Scope: None Oct 03 14:58:29.041445 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: User-Agent: python-urllib3/1.26.12 Oct 03 14:58:29.041445 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Auth-Token: gAAAAABjOvcaThjSXmST5Zui92tHpMFw7Oxu-LFHnLknGWdFg73n571Y94smvW3XiTCJONsYXW31rAR_Uk3b29zBX0vJUsq5e-sWUiw8SznibgFubZYgKjvRE5b1DEDp_CtTDUUHWp1Zy_ofQJQKHoqdksglIT7DpAg5H98Wcz58Zuh9fuXxiw4 Oct 03 14:58:29.041445 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Id: None Oct 03 14:58:29.041445 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Name: None Oct 03 14:58:29.041445 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Identity-Status: Confirmed Oct 03 14:58:29.041445 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Is-Admin-Project: True Oct 03 14:58:29.041445 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Openstack-Nova-Api-Version: 2.20 Oct 03 14:58:29.041445 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Id: default Oct 03 14:58:29.041445 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Name: Default Oct 03 14:58:29.041445 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Id: 7f48b2441eec48c4ac784844e475a9e9 Oct 03 14:58:29.041445 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-558801479 Oct 03 14:58:29.041445 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Role: member,reader Oct 03 14:58:29.041445 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Roles: member,reader Oct 03 14:58:29.043031 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7f48b2441eec48c4ac784844e475a9e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7f48b2441eec48c4ac784844e475a9e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7f48b2441eec48c4ac784844e475a9e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7f48b2441eec48c4ac784844e475a9e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 14:58:29.043031 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant: tempest-AttachVolumeShelveTestJSON-558801479 Oct 03 14:58:29.043031 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Id: 7f48b2441eec48c4ac784844e475a9e9 Oct 03 14:58:29.043031 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-558801479 Oct 03 14:58:29.043031 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User: tempest-AttachVolumeShelveTestJSON-558801479-project Oct 03 14:58:29.043031 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Id: default Oct 03 14:58:29.043031 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Name: Default Oct 03 14:58:29.043031 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Id: 9e5325f010ae4359bd6b514a1995614d Oct 03 14:58:29.043031 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Name: tempest-AttachVolumeShelveTestJSON-558801479-project Oct 03 14:58:29.043031 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: method: > Oct 03 14:58:29.043031 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: exception: Instance 27879d6c-62f5-4281-b134-faecf706a2db could not be found. Oct 03 14:58:29.043031 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: action_args: {'id': '27879d6c-62f5-4281-b134-faecf706a2db'} Oct 03 14:58:29.043917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:58:29.043917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:29.043917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:58:29.043917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:58:29.043917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:58:29.043917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:58:29.043917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:58:29.043917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:58:29.043917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:58:29.043917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:58:29.043917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27879d6c-62f5-4281-b134-faecf706a2db could not be found. Oct 03 14:58:29.043917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:58:29.043917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:58:29.043917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:58:29.043917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:29.043917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:58:29.043917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:58:29.043917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:58:29.043917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:58:29.043917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:58:29.045084 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:58:29.045084 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:58:29.045084 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:58:29.045084 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:58:29.045084 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:58:29.045084 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:58:29.045084 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:58:29.045084 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27879d6c-62f5-4281-b134-faecf706a2db could not be found. Oct 03 14:58:29.045084 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:58:29.045084 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:58:29.045084 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:58:29.045084 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:29.045084 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:58:29.045084 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:58:29.045084 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:58:29.045084 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:58:29.045084 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27879d6c-62f5-4281-b134-faecf706a2db could not be found. Oct 03 14:58:29.045084 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:58:29.046160 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-00c473ef-3db6-4430-811c-49d7441f3800 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Returning 404 to user: Instance 27879d6c-62f5-4281-b134-faecf706a2db could not be found. {{(pid=126852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:58:29.046160 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-00c473ef-3db6-4430-811c-49d7441f3800 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 404 len: 111 microversion: 2.20 time: 0.029260 Oct 03 14:58:29.046160 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 338/711] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:29 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:58:29.052478 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-2d699e85-2b30-4933-97ac-a902cbf01bc5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '.version_select at 0x7fe0d35229d0>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:29.070821 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-2d699e85-2b30-4933-97ac-a902cbf01bc5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-931744686" status: 204 len: 0 microversion: 2.20 time: 0.022152 Oct 03 14:58:29.071367 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 374/712] 10.222.0.46 () {60 vars in 1259 bytes} [Mon Oct 3 14:58:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-931744686 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 14:58:29.521755 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-3e184fc4-379a-4a3c-a2ed-40f7938e9573 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:29.522366 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-3e184fc4-379a-4a3c-a2ed-40f7938e9573 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 1923d108-de98-422f-a3af-85b5bd792b35] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:29.528454 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3e184fc4-379a-4a3c-a2ed-40f7938e9573 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:29.528942 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3e184fc4-379a-4a3c-a2ed-40f7938e9573 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:29.529376 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3e184fc4-379a-4a3c-a2ed-40f7938e9573 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:29.530101 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3e184fc4-379a-4a3c-a2ed-40f7938e9573 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:29.531049 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3e184fc4-379a-4a3c-a2ed-40f7938e9573 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:29.531466 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3e184fc4-379a-4a3c-a2ed-40f7938e9573 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:29.745987 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-3e184fc4-379a-4a3c-a2ed-40f7938e9573 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:29.753829 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-3e184fc4-379a-4a3c-a2ed-40f7938e9573 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35" status: 200 len: 1265 microversion: 2.1 time: 0.235926 Oct 03 14:58:29.754396 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 339/713] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:29 2022] GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35 => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:29.995547 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-15792701-5f32-4cad-b57a-71fe19f5edab tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Action: 'create', calling method: .version_select at 0x7fe0d6c90e50>, body: {"keypair": {"name": "tempest-keypair-572081692", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUNw76BdlQdAAKIz5xcvL2oV+/LvpGPmxto4ALrHZJw/c3kRHjquRxxuGf/7xga6Wr5Crg3hGCETUJy/OEjatET9sl0ZCRn+Ake3H5QkrZ+Gh0Bmh016wlyC7MLVMSV9Q=="}} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:58:30.012071 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.quota [None req-15792701-5f32-4cad-b57a-71fe19f5edab tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Getting quotas for project 7f48b2441eec48c4ac784844e475a9e9. Resources: {'key_pairs'} {{(pid=126851) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:58:30.016421 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.quota [None req-15792701-5f32-4cad-b57a-71fe19f5edab tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Getting quotas for user 9e5325f010ae4359bd6b514a1995614d and project 7f48b2441eec48c4ac784844e475a9e9. Resources: {'key_pairs'} {{(pid=126851) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:58:30.038906 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-15792701-5f32-4cad-b57a-71fe19f5edab tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.047395 Oct 03 14:58:30.039511 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 375/714] 10.222.0.46 () {62 vars in 1200 bytes} [Mon Oct 3 14:58:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 03 14:58:30.089704 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-99ebd00d-1edc-4e3e-b64f-9554b4bb3408 req-75984fe5-0685-4d5c-bf82-c3b3763e7159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1923d108-de98-422f-a3af-85b5bd792b35", "name": "network-vif-plugged", "status": "completed", "tag": "96b0cff0-5314-4971-92cf-71b39981d342"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:58:30.101395 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-99ebd00d-1edc-4e3e-b64f-9554b4bb3408 req-75984fe5-0685-4d5c-bf82-c3b3763e7159 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:30.102104 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-99ebd00d-1edc-4e3e-b64f-9554b4bb3408 req-75984fe5-0685-4d5c-bf82-c3b3763e7159 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:30.102579 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-99ebd00d-1edc-4e3e-b64f-9554b4bb3408 req-75984fe5-0685-4d5c-bf82-c3b3763e7159 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:30.113830 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-99ebd00d-1edc-4e3e-b64f-9554b4bb3408 req-75984fe5-0685-4d5c-bf82-c3b3763e7159 service nova] Creating event network-vif-plugged:96b0cff0-5314-4971-92cf-71b39981d342 for instance 1923d108-de98-422f-a3af-85b5bd792b35 on hv-cinder-85987 Oct 03 14:58:30.118966 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-99ebd00d-1edc-4e3e-b64f-9554b4bb3408 req-75984fe5-0685-4d5c-bf82-c3b3763e7159 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033409 Oct 03 14:58:30.120469 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 340/715] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:58:30.777643 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-bed3c36f-67ea-4865-81af-c306130e6484 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:30.778268 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-bed3c36f-67ea-4865-81af-c306130e6484 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 1923d108-de98-422f-a3af-85b5bd792b35] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:30.784260 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bed3c36f-67ea-4865-81af-c306130e6484 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:30.784752 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bed3c36f-67ea-4865-81af-c306130e6484 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:30.785192 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bed3c36f-67ea-4865-81af-c306130e6484 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:30.785914 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bed3c36f-67ea-4865-81af-c306130e6484 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:30.786376 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bed3c36f-67ea-4865-81af-c306130e6484 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:30.786803 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bed3c36f-67ea-4865-81af-c306130e6484 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:30.920735 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-bed3c36f-67ea-4865-81af-c306130e6484 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:30.929080 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-bed3c36f-67ea-4865-81af-c306130e6484 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35" status: 200 len: 1265 microversion: 2.1 time: 0.155875 Oct 03 14:58:30.929676 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 376/716] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:30 2022] GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:31.274091 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-6bda65b1-74cf-4376-91c6-57b7c95e0010 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-26001345", "imageRef": "add7a872-2ca1-4366-9a93-f0663fdb297b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e62ce727-fdfc-4635-82f1-b266a0898b13"}], "security_groups": [{"name": "tempest-securitygroup--1206311532"}], "key_name": "tempest-keypair-572081692", "user_data": "}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:58:31.375873 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.network.neutron [None req-6bda65b1-74cf-4376-91c6-57b7c95e0010 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] validate_networks() for [('e62ce727-fdfc-4635-82f1-b266a0898b13', None, None, None, None, None)] {{(pid=126852) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:58:31.735812 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-6bda65b1-74cf-4376-91c6-57b7c95e0010 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Flavor limits 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:58:31.736234 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-6bda65b1-74cf-4376-91c6-57b7c95e0010 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Image limits 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:58:31.736707 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-6bda65b1-74cf-4376-91c6-57b7c95e0010 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Flavor pref 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:58:31.737114 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-6bda65b1-74cf-4376-91c6-57b7c95e0010 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Image pref 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:58:31.737548 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-6bda65b1-74cf-4376-91c6-57b7c95e0010 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:58:31.746209 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6bda65b1-74cf-4376-91c6-57b7c95e0010 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:31.746713 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6bda65b1-74cf-4376-91c6-57b7c95e0010 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:31.747148 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6bda65b1-74cf-4376-91c6-57b7c95e0010 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:31.747874 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6bda65b1-74cf-4376-91c6-57b7c95e0010 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:31.748329 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6bda65b1-74cf-4376-91c6-57b7c95e0010 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:31.748755 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6bda65b1-74cf-4376-91c6-57b7c95e0010 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:31.766025 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-6bda65b1-74cf-4376-91c6-57b7c95e0010 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Getting quotas for project 7f48b2441eec48c4ac784844e475a9e9. Resources: {'ram', 'instances', 'cores'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:58:31.769917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-6bda65b1-74cf-4376-91c6-57b7c95e0010 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Getting quotas for user 9e5325f010ae4359bd6b514a1995614d and project 7f48b2441eec48c4ac784844e475a9e9. Resources: {'ram', 'instances', 'cores'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:58:31.780613 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-6bda65b1-74cf-4376-91c6-57b7c95e0010 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Going to run 1 instances... {{(pid=126852) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:58:31.783004 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-6bda65b1-74cf-4376-91c6-57b7c95e0010 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='add7a872-2ca1-4366-9a93-f0663fdb297b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:58:31.829772 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-6bda65b1-74cf-4376-91c6-57b7c95e0010 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.560698 Oct 03 14:58:31.830418 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 341/717] 10.222.0.46 () {62 vars in 1188 bytes} [Mon Oct 3 14:58:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 03 14:58:31.841775 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-f8844888-25f3-43c2-ae16-1d85c067c290 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:31.842384 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-f8844888-25f3-43c2-ae16-1d85c067c290 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:31.898021 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-f8844888-25f3-43c2-ae16-1d85c067c290 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:31.919236 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-f8844888-25f3-43c2-ae16-1d85c067c290 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:31.920731 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-f8844888-25f3-43c2-ae16-1d85c067c290 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:31.926140 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-f8844888-25f3-43c2-ae16-1d85c067c290 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1279 microversion: 2.20 time: 0.083915 Oct 03 14:58:31.927640 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 377/718] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:31 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1279 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:58:31.953324 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-5007b231-e7f2-44ba-928c-78daa515cbe9 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:31.953976 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-5007b231-e7f2-44ba-928c-78daa515cbe9 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 1923d108-de98-422f-a3af-85b5bd792b35] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:31.962988 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5007b231-e7f2-44ba-928c-78daa515cbe9 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:31.963590 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5007b231-e7f2-44ba-928c-78daa515cbe9 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:31.964170 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5007b231-e7f2-44ba-928c-78daa515cbe9 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:31.965082 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5007b231-e7f2-44ba-928c-78daa515cbe9 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:31.965671 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5007b231-e7f2-44ba-928c-78daa515cbe9 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:31.966170 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5007b231-e7f2-44ba-928c-78daa515cbe9 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:32.115360 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-5007b231-e7f2-44ba-928c-78daa515cbe9 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:32.123128 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-5007b231-e7f2-44ba-928c-78daa515cbe9 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35" status: 200 len: 1452 microversion: 2.1 time: 0.174412 Oct 03 14:58:32.123700 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 342/719] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:31 2022] GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35 => generated 1452 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:32.147518 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-b1dc2e33-7517-48b1-85fe-b137ad9a8504 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:32.148444 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-b1dc2e33-7517-48b1-85fe-b137ad9a8504 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 1923d108-de98-422f-a3af-85b5bd792b35] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:32.155076 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b1dc2e33-7517-48b1-85fe-b137ad9a8504 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:32.155602 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b1dc2e33-7517-48b1-85fe-b137ad9a8504 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:32.156043 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b1dc2e33-7517-48b1-85fe-b137ad9a8504 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:32.156746 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b1dc2e33-7517-48b1-85fe-b137ad9a8504 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:32.157275 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b1dc2e33-7517-48b1-85fe-b137ad9a8504 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:32.157754 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b1dc2e33-7517-48b1-85fe-b137ad9a8504 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:32.297161 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-b1dc2e33-7517-48b1-85fe-b137ad9a8504 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:32.304994 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-b1dc2e33-7517-48b1-85fe-b137ad9a8504 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35" status: 200 len: 1452 microversion: 2.1 time: 0.161361 Oct 03 14:58:32.305671 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 378/720] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:32 2022] GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35 => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:32.954070 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-0c2dadd8-447b-49c5-a9e0-3abb8b8dde98 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:32.954874 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-0c2dadd8-447b-49c5-a9e0-3abb8b8dde98 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:32.962179 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0c2dadd8-447b-49c5-a9e0-3abb8b8dde98 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:32.962673 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0c2dadd8-447b-49c5-a9e0-3abb8b8dde98 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:32.963114 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0c2dadd8-447b-49c5-a9e0-3abb8b8dde98 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:32.963816 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0c2dadd8-447b-49c5-a9e0-3abb8b8dde98 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:32.964491 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0c2dadd8-447b-49c5-a9e0-3abb8b8dde98 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:32.964722 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0c2dadd8-447b-49c5-a9e0-3abb8b8dde98 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:33.028141 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-0c2dadd8-447b-49c5-a9e0-3abb8b8dde98 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:33.037415 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-0c2dadd8-447b-49c5-a9e0-3abb8b8dde98 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:33.039039 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-0c2dadd8-447b-49c5-a9e0-3abb8b8dde98 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:33.040294 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-0c2dadd8-447b-49c5-a9e0-3abb8b8dde98 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1331 microversion: 2.20 time: 0.090892 Oct 03 14:58:33.040928 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 343/721] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:32 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1331 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:58:34.066200 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-342ab938-f167-4721-9bbf-6893854d51fa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:34.066763 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-342ab938-f167-4721-9bbf-6893854d51fa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:34.073140 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-342ab938-f167-4721-9bbf-6893854d51fa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:34.073664 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-342ab938-f167-4721-9bbf-6893854d51fa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:34.074107 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-342ab938-f167-4721-9bbf-6893854d51fa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:34.074800 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-342ab938-f167-4721-9bbf-6893854d51fa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:34.075258 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-342ab938-f167-4721-9bbf-6893854d51fa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:34.075682 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-342ab938-f167-4721-9bbf-6893854d51fa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:34.160220 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-342ab938-f167-4721-9bbf-6893854d51fa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:34.168720 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-342ab938-f167-4721-9bbf-6893854d51fa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:34.170629 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-342ab938-f167-4721-9bbf-6893854d51fa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:34.172312 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-342ab938-f167-4721-9bbf-6893854d51fa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1337 microversion: 2.20 time: 0.110190 Oct 03 14:58:34.173148 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 379/722] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:34 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1337 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:58:34.261447 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-24be72e2-377a-451d-ac70-c01f1b1f5d6a req-d73dda82-80ac-4cfe-b01c-745457ab4f62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1923d108-de98-422f-a3af-85b5bd792b35", "tag": "96b0cff0-5314-4971-92cf-71b39981d342"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:58:34.273172 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-24be72e2-377a-451d-ac70-c01f1b1f5d6a req-d73dda82-80ac-4cfe-b01c-745457ab4f62 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:34.273809 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-24be72e2-377a-451d-ac70-c01f1b1f5d6a req-d73dda82-80ac-4cfe-b01c-745457ab4f62 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:34.274332 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-24be72e2-377a-451d-ac70-c01f1b1f5d6a req-d73dda82-80ac-4cfe-b01c-745457ab4f62 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:34.288850 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-24be72e2-377a-451d-ac70-c01f1b1f5d6a req-d73dda82-80ac-4cfe-b01c-745457ab4f62 service nova] Creating event network-changed:96b0cff0-5314-4971-92cf-71b39981d342 for instance 1923d108-de98-422f-a3af-85b5bd792b35 on hv-cinder-85987 Oct 03 14:58:34.294289 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-24be72e2-377a-451d-ac70-c01f1b1f5d6a req-d73dda82-80ac-4cfe-b01c-745457ab4f62 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037372 Oct 03 14:58:34.295628 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 344/723] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:58:35.198829 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-6d177629-8ca9-45e9-9f16-214855ef88fe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:35.200435 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-6d177629-8ca9-45e9-9f16-214855ef88fe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:35.204640 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:58:35.209128 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6d177629-8ca9-45e9-9f16-214855ef88fe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:35.209906 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6d177629-8ca9-45e9-9f16-214855ef88fe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:35.210347 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6d177629-8ca9-45e9-9f16-214855ef88fe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:35.211055 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6d177629-8ca9-45e9-9f16-214855ef88fe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:35.211514 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6d177629-8ca9-45e9-9f16-214855ef88fe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:35.211939 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6d177629-8ca9-45e9-9f16-214855ef88fe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:35.698053 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-6d177629-8ca9-45e9-9f16-214855ef88fe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:35.707226 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-6d177629-8ca9-45e9-9f16-214855ef88fe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:35.708683 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-6d177629-8ca9-45e9-9f16-214855ef88fe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:35.710448 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-6d177629-8ca9-45e9-9f16-214855ef88fe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1405 microversion: 2.20 time: 0.515732 Oct 03 14:58:35.711216 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 380/724] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:35 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1405 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:58:36.312513 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-a17ce070-838d-4a00-a7a1-bc05a7b2b8c6 req-00b4ab8b-122b-40ab-a1b2-f9e0ce7ca346 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "492aa42e-764b-4444-b4aa-c0ff2a4202d9", "tag": "cfdafec3-b426-4742-8d49-c455e689f120"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:58:36.321778 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-a17ce070-838d-4a00-a7a1-bc05a7b2b8c6 req-00b4ab8b-122b-40ab-a1b2-f9e0ce7ca346 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:36.322249 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-a17ce070-838d-4a00-a7a1-bc05a7b2b8c6 req-00b4ab8b-122b-40ab-a1b2-f9e0ce7ca346 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:36.322676 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-a17ce070-838d-4a00-a7a1-bc05a7b2b8c6 req-00b4ab8b-122b-40ab-a1b2-f9e0ce7ca346 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:36.333885 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-a17ce070-838d-4a00-a7a1-bc05a7b2b8c6 req-00b4ab8b-122b-40ab-a1b2-f9e0ce7ca346 service nova] Creating event network-changed:cfdafec3-b426-4742-8d49-c455e689f120 for instance 492aa42e-764b-4444-b4aa-c0ff2a4202d9 on hv-cinder-85987 Oct 03 14:58:36.338960 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-a17ce070-838d-4a00-a7a1-bc05a7b2b8c6 req-00b4ab8b-122b-40ab-a1b2-f9e0ce7ca346 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031662 Oct 03 14:58:36.339529 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 345/725] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:58:36.736043 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-d0ed8e5b-5347-4ae3-ac9a-46647ca8fa42 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:36.736643 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-d0ed8e5b-5347-4ae3-ac9a-46647ca8fa42 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:36.742983 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d0ed8e5b-5347-4ae3-ac9a-46647ca8fa42 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:36.743462 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d0ed8e5b-5347-4ae3-ac9a-46647ca8fa42 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:36.743907 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d0ed8e5b-5347-4ae3-ac9a-46647ca8fa42 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:36.744568 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d0ed8e5b-5347-4ae3-ac9a-46647ca8fa42 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:36.745017 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d0ed8e5b-5347-4ae3-ac9a-46647ca8fa42 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:36.745437 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d0ed8e5b-5347-4ae3-ac9a-46647ca8fa42 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:36.875894 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-d0ed8e5b-5347-4ae3-ac9a-46647ca8fa42 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:36.888213 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-d0ed8e5b-5347-4ae3-ac9a-46647ca8fa42 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:36.889660 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-d0ed8e5b-5347-4ae3-ac9a-46647ca8fa42 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:36.890758 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-d0ed8e5b-5347-4ae3-ac9a-46647ca8fa42 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1405 microversion: 2.20 time: 0.159120 Oct 03 14:58:36.891309 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 381/726] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:36 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:58:37.916596 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-329aaad0-2d6d-499b-bddc-4d6b9211ea46 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:37.917284 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-329aaad0-2d6d-499b-bddc-4d6b9211ea46 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:37.923378 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-329aaad0-2d6d-499b-bddc-4d6b9211ea46 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:37.923856 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-329aaad0-2d6d-499b-bddc-4d6b9211ea46 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:37.924284 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-329aaad0-2d6d-499b-bddc-4d6b9211ea46 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:37.924965 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-329aaad0-2d6d-499b-bddc-4d6b9211ea46 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:37.926046 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-329aaad0-2d6d-499b-bddc-4d6b9211ea46 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:37.926475 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-329aaad0-2d6d-499b-bddc-4d6b9211ea46 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:38.052346 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-329aaad0-2d6d-499b-bddc-4d6b9211ea46 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:38.060339 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-329aaad0-2d6d-499b-bddc-4d6b9211ea46 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:38.062346 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-329aaad0-2d6d-499b-bddc-4d6b9211ea46 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:38.063430 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-329aaad0-2d6d-499b-bddc-4d6b9211ea46 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1405 microversion: 2.20 time: 0.151508 Oct 03 14:58:38.063981 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 346/727] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:37 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:58:39.088579 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-8f2f9789-edd9-461e-aa76-cfcfd9867a8d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:39.089319 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-8f2f9789-edd9-461e-aa76-cfcfd9867a8d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:39.096312 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8f2f9789-edd9-461e-aa76-cfcfd9867a8d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:39.096810 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8f2f9789-edd9-461e-aa76-cfcfd9867a8d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:39.097241 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8f2f9789-edd9-461e-aa76-cfcfd9867a8d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:39.097968 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8f2f9789-edd9-461e-aa76-cfcfd9867a8d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:39.098420 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8f2f9789-edd9-461e-aa76-cfcfd9867a8d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:39.098845 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8f2f9789-edd9-461e-aa76-cfcfd9867a8d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:39.323364 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-8f2f9789-edd9-461e-aa76-cfcfd9867a8d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:39.332375 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-8f2f9789-edd9-461e-aa76-cfcfd9867a8d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:39.334057 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-8f2f9789-edd9-461e-aa76-cfcfd9867a8d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:39.335418 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-8f2f9789-edd9-461e-aa76-cfcfd9867a8d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1405 microversion: 2.20 time: 0.251074 Oct 03 14:58:39.336249 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 382/728] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:39 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1405 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:58:40.360208 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-54980f23-9291-4284-a50e-7fabd375c7ae tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:40.360818 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-54980f23-9291-4284-a50e-7fabd375c7ae tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:40.367283 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-54980f23-9291-4284-a50e-7fabd375c7ae tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:40.367764 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-54980f23-9291-4284-a50e-7fabd375c7ae tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:40.368198 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-54980f23-9291-4284-a50e-7fabd375c7ae tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:40.368886 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-54980f23-9291-4284-a50e-7fabd375c7ae tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:40.369347 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-54980f23-9291-4284-a50e-7fabd375c7ae tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:40.369800 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-54980f23-9291-4284-a50e-7fabd375c7ae tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:40.499149 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-54980f23-9291-4284-a50e-7fabd375c7ae tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:40.507123 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-54980f23-9291-4284-a50e-7fabd375c7ae tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:40.508558 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-54980f23-9291-4284-a50e-7fabd375c7ae tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:40.509704 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-54980f23-9291-4284-a50e-7fabd375c7ae tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1405 microversion: 2.20 time: 0.153415 Oct 03 14:58:40.510267 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 347/729] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:40 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:58:41.535882 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-af3f513a-fd3d-48bb-9918-7a3a1d2ec661 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:41.536406 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-af3f513a-fd3d-48bb-9918-7a3a1d2ec661 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:41.542336 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-af3f513a-fd3d-48bb-9918-7a3a1d2ec661 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:41.542813 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-af3f513a-fd3d-48bb-9918-7a3a1d2ec661 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:41.543239 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-af3f513a-fd3d-48bb-9918-7a3a1d2ec661 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:41.543917 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-af3f513a-fd3d-48bb-9918-7a3a1d2ec661 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:41.544367 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-af3f513a-fd3d-48bb-9918-7a3a1d2ec661 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:41.544782 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-af3f513a-fd3d-48bb-9918-7a3a1d2ec661 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:41.669733 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-af3f513a-fd3d-48bb-9918-7a3a1d2ec661 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:41.677690 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-af3f513a-fd3d-48bb-9918-7a3a1d2ec661 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:41.679119 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-af3f513a-fd3d-48bb-9918-7a3a1d2ec661 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:41.680202 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-af3f513a-fd3d-48bb-9918-7a3a1d2ec661 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1405 microversion: 2.20 time: 0.148421 Oct 03 14:58:41.680756 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 383/730] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:41 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1405 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:58:41.977992 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-9412d5bd-0610-4254-8f42-42c1a44baf5f req-9013f144-7918-4ad4-a07a-75d6c7aaaa42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "492aa42e-764b-4444-b4aa-c0ff2a4202d9", "name": "network-vif-plugged", "status": "completed", "tag": "cfdafec3-b426-4742-8d49-c455e689f120"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:58:41.984207 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell0:SELECT=2 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:58:41.984875 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell0:SELECT=6 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:58:41.991438 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-9412d5bd-0610-4254-8f42-42c1a44baf5f req-9013f144-7918-4ad4-a07a-75d6c7aaaa42 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:41.991953 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-9412d5bd-0610-4254-8f42-42c1a44baf5f req-9013f144-7918-4ad4-a07a-75d6c7aaaa42 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:41.992385 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-9412d5bd-0610-4254-8f42-42c1a44baf5f req-9013f144-7918-4ad4-a07a-75d6c7aaaa42 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:42.004040 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-9412d5bd-0610-4254-8f42-42c1a44baf5f req-9013f144-7918-4ad4-a07a-75d6c7aaaa42 service nova] Creating event network-vif-plugged:cfdafec3-b426-4742-8d49-c455e689f120 for instance 492aa42e-764b-4444-b4aa-c0ff2a4202d9 on hv-cinder-85987 Oct 03 14:58:42.008725 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-9412d5bd-0610-4254-8f42-42c1a44baf5f req-9013f144-7918-4ad4-a07a-75d6c7aaaa42 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034507 Oct 03 14:58:42.009311 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 348/731] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:58:42.705920 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-888f4929-c99e-4d9f-b6a7-42b5d9bc8537 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:42.706530 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-888f4929-c99e-4d9f-b6a7-42b5d9bc8537 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:42.708399 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell0:SELECT=6 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:58:42.714465 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-888f4929-c99e-4d9f-b6a7-42b5d9bc8537 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:42.714975 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-888f4929-c99e-4d9f-b6a7-42b5d9bc8537 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:42.715409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-888f4929-c99e-4d9f-b6a7-42b5d9bc8537 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:42.716098 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-888f4929-c99e-4d9f-b6a7-42b5d9bc8537 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:42.716554 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-888f4929-c99e-4d9f-b6a7-42b5d9bc8537 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:42.716972 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-888f4929-c99e-4d9f-b6a7-42b5d9bc8537 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:42.843420 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-888f4929-c99e-4d9f-b6a7-42b5d9bc8537 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:42.845606 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=100 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:58:42.852574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-888f4929-c99e-4d9f-b6a7-42b5d9bc8537 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:42.854033 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-888f4929-c99e-4d9f-b6a7-42b5d9bc8537 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:42.855132 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-888f4929-c99e-4d9f-b6a7-42b5d9bc8537 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1405 microversion: 2.20 time: 0.153748 Oct 03 14:58:42.855693 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 384/732] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:42 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:58:43.881420 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-23c65e73-845d-453b-9d97-1f272cc658b3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:43.882062 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-23c65e73-845d-453b-9d97-1f272cc658b3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:43.888092 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-23c65e73-845d-453b-9d97-1f272cc658b3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:43.888572 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-23c65e73-845d-453b-9d97-1f272cc658b3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:43.889007 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-23c65e73-845d-453b-9d97-1f272cc658b3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:43.889732 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-23c65e73-845d-453b-9d97-1f272cc658b3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:43.890191 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-23c65e73-845d-453b-9d97-1f272cc658b3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:43.890614 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-23c65e73-845d-453b-9d97-1f272cc658b3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:44.021650 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-23c65e73-845d-453b-9d97-1f272cc658b3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:44.029610 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-23c65e73-845d-453b-9d97-1f272cc658b3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:44.031709 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-23c65e73-845d-453b-9d97-1f272cc658b3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:44.032824 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-23c65e73-845d-453b-9d97-1f272cc658b3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1405 microversion: 2.20 time: 0.156203 Oct 03 14:58:44.033391 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 349/733] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:43 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:58:45.057877 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-e3bd7b94-cb59-4b3b-9e42-221df5bc9b59 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:45.058470 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-e3bd7b94-cb59-4b3b-9e42-221df5bc9b59 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:45.065528 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e3bd7b94-cb59-4b3b-9e42-221df5bc9b59 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:45.066020 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e3bd7b94-cb59-4b3b-9e42-221df5bc9b59 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:45.066455 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e3bd7b94-cb59-4b3b-9e42-221df5bc9b59 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:45.067143 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e3bd7b94-cb59-4b3b-9e42-221df5bc9b59 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:45.067598 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e3bd7b94-cb59-4b3b-9e42-221df5bc9b59 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:45.068021 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e3bd7b94-cb59-4b3b-9e42-221df5bc9b59 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:45.195911 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-e3bd7b94-cb59-4b3b-9e42-221df5bc9b59 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:45.203874 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-e3bd7b94-cb59-4b3b-9e42-221df5bc9b59 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:45.205286 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-e3bd7b94-cb59-4b3b-9e42-221df5bc9b59 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:45.206469 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-e3bd7b94-cb59-4b3b-9e42-221df5bc9b59 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1598 microversion: 2.20 time: 0.152577 Oct 03 14:58:45.207029 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 385/734] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:45 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:58:45.231198 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-11265208-005e-44b5-975c-cb29021f97e7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:45.231712 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-11265208-005e-44b5-975c-cb29021f97e7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:45.238642 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-11265208-005e-44b5-975c-cb29021f97e7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:45.239124 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-11265208-005e-44b5-975c-cb29021f97e7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:45.239559 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-11265208-005e-44b5-975c-cb29021f97e7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:45.240247 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-11265208-005e-44b5-975c-cb29021f97e7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:45.240702 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-11265208-005e-44b5-975c-cb29021f97e7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:45.241125 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-11265208-005e-44b5-975c-cb29021f97e7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:45.316076 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-11265208-005e-44b5-975c-cb29021f97e7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.088623 Oct 03 14:58:45.316776 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 350/735] 10.222.0.46 () {60 vars in 1316 bytes} [Mon Oct 3 14:58:45 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:58:46.095860 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-283717fd-c082-40d1-a1f6-3d5fdfdb59db tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:46.096349 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-283717fd-c082-40d1-a1f6-3d5fdfdb59db tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:46.102629 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-283717fd-c082-40d1-a1f6-3d5fdfdb59db tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:46.103110 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-283717fd-c082-40d1-a1f6-3d5fdfdb59db tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:46.103539 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-283717fd-c082-40d1-a1f6-3d5fdfdb59db tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:46.104224 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-283717fd-c082-40d1-a1f6-3d5fdfdb59db tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:46.104680 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-283717fd-c082-40d1-a1f6-3d5fdfdb59db tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:46.105095 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-283717fd-c082-40d1-a1f6-3d5fdfdb59db tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:46.187070 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.objects.instance [None req-283717fd-c082-40d1-a1f6-3d5fdfdb59db tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lazy-loading 'services' on Instance uuid 3a42b833-728b-44e8-af21-fe86e25c035f {{(pid=126851) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:58:46.237405 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-e9a453e2-275a-4fa4-bda6-7632c98ed244 req-2e015a13-6e6b-40aa-b7a4-bc0047100734 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "492aa42e-764b-4444-b4aa-c0ff2a4202d9", "tag": "cfdafec3-b426-4742-8d49-c455e689f120"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:58:46.249673 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-e9a453e2-275a-4fa4-bda6-7632c98ed244 req-2e015a13-6e6b-40aa-b7a4-bc0047100734 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:46.250164 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-e9a453e2-275a-4fa4-bda6-7632c98ed244 req-2e015a13-6e6b-40aa-b7a4-bc0047100734 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:46.250666 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-e9a453e2-275a-4fa4-bda6-7632c98ed244 req-2e015a13-6e6b-40aa-b7a4-bc0047100734 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:46.265321 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-e9a453e2-275a-4fa4-bda6-7632c98ed244 req-2e015a13-6e6b-40aa-b7a4-bc0047100734 service nova] Creating event network-changed:cfdafec3-b426-4742-8d49-c455e689f120 for instance 492aa42e-764b-4444-b4aa-c0ff2a4202d9 on hv-cinder-85987 Oct 03 14:58:46.265831 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-283717fd-c082-40d1-a1f6-3d5fdfdb59db tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f/os-volume_attachments/50da1ed0-3553-4217-99ce-4fc762f03f90" status: 202 len: 0 microversion: 2.1 time: 0.173640 Oct 03 14:58:46.266553 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 386/736] 10.222.0.46 () {58 vars in 1416 bytes} [Mon Oct 3 14:58:46 2022] DELETE /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f/os-volume_attachments/50da1ed0-3553-4217-99ce-4fc762f03f90 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:58:46.270540 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-e9a453e2-275a-4fa4-bda6-7632c98ed244 req-2e015a13-6e6b-40aa-b7a4-bc0047100734 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037874 Oct 03 14:58:46.271252 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 351/737] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:58:46.275239 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-47b7259b-2c9d-49a9-aee8-58958eb55d08 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:46.280053 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-47b7259b-2c9d-49a9-aee8-58958eb55d08 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:46.286893 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-47b7259b-2c9d-49a9-aee8-58958eb55d08 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:46.287559 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-47b7259b-2c9d-49a9-aee8-58958eb55d08 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:46.288088 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-47b7259b-2c9d-49a9-aee8-58958eb55d08 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:46.288965 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-47b7259b-2c9d-49a9-aee8-58958eb55d08 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:46.293539 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-47b7259b-2c9d-49a9-aee8-58958eb55d08 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:46.293539 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-47b7259b-2c9d-49a9-aee8-58958eb55d08 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:46.324817 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-47b7259b-2c9d-49a9-aee8-58958eb55d08 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053541 Oct 03 14:58:46.325491 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 387/738] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 3 14:58:46 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:58:47.338994 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-34e5e597-d52f-4a00-a0ee-cb39027151d6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:47.341269 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-34e5e597-d52f-4a00-a0ee-cb39027151d6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:47.349033 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-34e5e597-d52f-4a00-a0ee-cb39027151d6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:47.349540 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-34e5e597-d52f-4a00-a0ee-cb39027151d6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:47.349985 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-34e5e597-d52f-4a00-a0ee-cb39027151d6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:47.350725 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-34e5e597-d52f-4a00-a0ee-cb39027151d6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:47.351188 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-34e5e597-d52f-4a00-a0ee-cb39027151d6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:47.351621 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-34e5e597-d52f-4a00-a0ee-cb39027151d6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:47.377041 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:58:47.390639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-34e5e597-d52f-4a00-a0ee-cb39027151d6 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056929 Oct 03 14:58:47.391450 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 352/739] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 3 14:58:47 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:58:48.403203 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-52a564f7-227f-47e4-91ab-8d1205ae4c8a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:48.405944 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-52a564f7-227f-47e4-91ab-8d1205ae4c8a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:48.412249 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-52a564f7-227f-47e4-91ab-8d1205ae4c8a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:48.412733 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-52a564f7-227f-47e4-91ab-8d1205ae4c8a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:48.413170 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-52a564f7-227f-47e4-91ab-8d1205ae4c8a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:48.413891 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-52a564f7-227f-47e4-91ab-8d1205ae4c8a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:48.414354 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-52a564f7-227f-47e4-91ab-8d1205ae4c8a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:48.414783 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-52a564f7-227f-47e4-91ab-8d1205ae4c8a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:48.443042 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-52a564f7-227f-47e4-91ab-8d1205ae4c8a tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043792 Oct 03 14:58:48.443589 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 388/740] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 3 14:58:48 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:58:48.520373 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-69f5570f-c659-477d-b769-be731d0b2677 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:48.520934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-69f5570f-c659-477d-b769-be731d0b2677 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:48.527140 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-69f5570f-c659-477d-b769-be731d0b2677 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:48.527617 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-69f5570f-c659-477d-b769-be731d0b2677 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:48.528050 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-69f5570f-c659-477d-b769-be731d0b2677 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:48.528760 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-69f5570f-c659-477d-b769-be731d0b2677 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:48.529211 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-69f5570f-c659-477d-b769-be731d0b2677 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:48.530210 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-69f5570f-c659-477d-b769-be731d0b2677 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:48.554017 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-69f5570f-c659-477d-b769-be731d0b2677 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Going to try to terminate instance {{(pid=126852) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:58:48.612678 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:58:48.629696 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-69f5570f-c659-477d-b769-be731d0b2677 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 204 len: 0 microversion: 2.1 time: 0.113101 Oct 03 14:58:48.630287 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 353/741] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 3 14:58:48 2022] DELETE /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:58:48.638133 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-c3638b4b-6c3a-4f85-a1fe-19379b474941 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:48.638746 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-c3638b4b-6c3a-4f85-a1fe-19379b474941 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:48.645152 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c3638b4b-6c3a-4f85-a1fe-19379b474941 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:48.645679 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c3638b4b-6c3a-4f85-a1fe-19379b474941 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:48.646116 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c3638b4b-6c3a-4f85-a1fe-19379b474941 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:48.646810 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c3638b4b-6c3a-4f85-a1fe-19379b474941 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:48.647262 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c3638b4b-6c3a-4f85-a1fe-19379b474941 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:48.647687 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c3638b4b-6c3a-4f85-a1fe-19379b474941 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:48.772018 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-c3638b4b-6c3a-4f85-a1fe-19379b474941 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:48.780269 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-c3638b4b-6c3a-4f85-a1fe-19379b474941 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1689 microversion: 2.1 time: 0.145257 Oct 03 14:58:48.780841 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 389/742] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:48 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1689 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:49.806132 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-d25400ed-2b2c-483f-a53c-9c9aa02372b7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:49.806854 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-d25400ed-2b2c-483f-a53c-9c9aa02372b7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:49.813186 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d25400ed-2b2c-483f-a53c-9c9aa02372b7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:49.813702 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d25400ed-2b2c-483f-a53c-9c9aa02372b7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:49.814136 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d25400ed-2b2c-483f-a53c-9c9aa02372b7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:49.814819 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d25400ed-2b2c-483f-a53c-9c9aa02372b7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:49.815269 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d25400ed-2b2c-483f-a53c-9c9aa02372b7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:49.815687 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d25400ed-2b2c-483f-a53c-9c9aa02372b7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:49.945652 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-d25400ed-2b2c-483f-a53c-9c9aa02372b7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:49.953232 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-d25400ed-2b2c-483f-a53c-9c9aa02372b7 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1689 microversion: 2.1 time: 0.151200 Oct 03 14:58:49.953826 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 354/743] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:49 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:50.976911 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-6e44f220-62ca-4476-aebc-e650aadb01f1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:50.977536 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-6e44f220-62ca-4476-aebc-e650aadb01f1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:50.984513 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6e44f220-62ca-4476-aebc-e650aadb01f1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:50.984996 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6e44f220-62ca-4476-aebc-e650aadb01f1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:50.985432 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6e44f220-62ca-4476-aebc-e650aadb01f1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:50.986145 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6e44f220-62ca-4476-aebc-e650aadb01f1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:50.986604 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6e44f220-62ca-4476-aebc-e650aadb01f1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:50.987037 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6e44f220-62ca-4476-aebc-e650aadb01f1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:51.117449 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-6e44f220-62ca-4476-aebc-e650aadb01f1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:51.125032 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-6e44f220-62ca-4476-aebc-e650aadb01f1 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1689 microversion: 2.1 time: 0.151971 Oct 03 14:58:51.125612 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 390/744] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:50 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:52.148335 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-8a398848-bc83-4394-807e-68ecebb504d4 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:52.148939 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-8a398848-bc83-4394-807e-68ecebb504d4 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:52.155552 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8a398848-bc83-4394-807e-68ecebb504d4 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:52.156035 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8a398848-bc83-4394-807e-68ecebb504d4 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:52.156470 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8a398848-bc83-4394-807e-68ecebb504d4 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:52.157159 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8a398848-bc83-4394-807e-68ecebb504d4 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:52.157663 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8a398848-bc83-4394-807e-68ecebb504d4 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:52.158088 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8a398848-bc83-4394-807e-68ecebb504d4 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:52.290583 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-8a398848-bc83-4394-807e-68ecebb504d4 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:52.299140 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-8a398848-bc83-4394-807e-68ecebb504d4 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1689 microversion: 2.1 time: 0.154641 Oct 03 14:58:52.299713 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 355/745] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:52 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:53.322658 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-17c7fa7b-ba68-4c40-9c6d-96658d8c00bb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:53.323414 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-17c7fa7b-ba68-4c40-9c6d-96658d8c00bb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:53.330340 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-17c7fa7b-ba68-4c40-9c6d-96658d8c00bb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:53.330858 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-17c7fa7b-ba68-4c40-9c6d-96658d8c00bb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:53.331294 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-17c7fa7b-ba68-4c40-9c6d-96658d8c00bb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:53.331982 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-17c7fa7b-ba68-4c40-9c6d-96658d8c00bb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:53.332442 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-17c7fa7b-ba68-4c40-9c6d-96658d8c00bb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:53.332862 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-17c7fa7b-ba68-4c40-9c6d-96658d8c00bb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:53.546664 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-17c7fa7b-ba68-4c40-9c6d-96658d8c00bb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:53.554326 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-17c7fa7b-ba68-4c40-9c6d-96658d8c00bb tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1689 microversion: 2.1 time: 0.235539 Oct 03 14:58:53.555110 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 391/746] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:53 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1689 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:54.039340 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-e5520c14-3b5b-417a-8b53-8a86ebf96bb3 req-674e557e-9d58-4b8e-af1b-65b3ecde61f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a42b833-728b-44e8-af21-fe86e25c035f", "name": "network-vif-deleted", "tag": "71f04a2e-59ac-4427-96fb-90ece95bcbde"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:58:54.056599 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-e5520c14-3b5b-417a-8b53-8a86ebf96bb3 req-674e557e-9d58-4b8e-af1b-65b3ecde61f3 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:54.057087 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-e5520c14-3b5b-417a-8b53-8a86ebf96bb3 req-674e557e-9d58-4b8e-af1b-65b3ecde61f3 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:54.057536 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-e5520c14-3b5b-417a-8b53-8a86ebf96bb3 req-674e557e-9d58-4b8e-af1b-65b3ecde61f3 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:54.071154 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-e5520c14-3b5b-417a-8b53-8a86ebf96bb3 req-674e557e-9d58-4b8e-af1b-65b3ecde61f3 service nova] Creating event network-vif-deleted:71f04a2e-59ac-4427-96fb-90ece95bcbde for instance 3a42b833-728b-44e8-af21-fe86e25c035f on hv-cinder-85987 Oct 03 14:58:54.076992 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-e5520c14-3b5b-417a-8b53-8a86ebf96bb3 req-674e557e-9d58-4b8e-af1b-65b3ecde61f3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041448 Oct 03 14:58:54.077936 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 356/747] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:58:54.578314 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-ba12adfc-8e64-4d38-a49b-928e3abc9462 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:54.578922 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-ba12adfc-8e64-4d38-a49b-928e3abc9462 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:54.585592 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ba12adfc-8e64-4d38-a49b-928e3abc9462 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:54.586082 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ba12adfc-8e64-4d38-a49b-928e3abc9462 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:54.586515 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ba12adfc-8e64-4d38-a49b-928e3abc9462 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:54.587205 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ba12adfc-8e64-4d38-a49b-928e3abc9462 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:54.587663 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ba12adfc-8e64-4d38-a49b-928e3abc9462 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:54.588089 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ba12adfc-8e64-4d38-a49b-928e3abc9462 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:54.618786 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ba12adfc-8e64-4d38-a49b-928e3abc9462 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:54.619259 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ba12adfc-8e64-4d38-a49b-928e3abc9462 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:54.619686 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ba12adfc-8e64-4d38-a49b-928e3abc9462 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:54.620122 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.objects.instance [None req-ba12adfc-8e64-4d38-a49b-928e3abc9462 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lazy-loading 'fault' on Instance uuid 3a42b833-728b-44e8-af21-fe86e25c035f {{(pid=126851) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:58:54.660432 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-ba12adfc-8e64-4d38-a49b-928e3abc9462 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:54.668028 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-ba12adfc-8e64-4d38-a49b-928e3abc9462 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 200 len: 1335 microversion: 2.1 time: 0.094126 Oct 03 14:58:54.668587 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 392/748] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:54 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 1335 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:55.691423 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-1d426c77-365a-4310-a520-e14d5e3d8eed tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:55.692112 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-1d426c77-365a-4310-a520-e14d5e3d8eed tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 3a42b833-728b-44e8-af21-fe86e25c035f] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:55.698637 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1d426c77-365a-4310-a520-e14d5e3d8eed tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:55.699147 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1d426c77-365a-4310-a520-e14d5e3d8eed tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:55.699579 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1d426c77-365a-4310-a520-e14d5e3d8eed tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:55.700262 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1d426c77-365a-4310-a520-e14d5e3d8eed tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:55.700711 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1d426c77-365a-4310-a520-e14d5e3d8eed tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:55.701130 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1d426c77-365a-4310-a520-e14d5e3d8eed tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:55.714233 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.wsgi [None req-1d426c77-365a-4310-a520-e14d5e3d8eed tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] HTTP exception thrown: Instance 3a42b833-728b-44e8-af21-fe86e25c035f could not be found. Oct 03 14:58:55.715801 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-1d426c77-365a-4310-a520-e14d5e3d8eed tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Request method failure captured: Oct 03 14:58:55.715801 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: request: GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f HTTP/1.1 Oct 03 14:58:55.715801 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept: application/json Oct 03 14:58:55.715801 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept-Encoding: identity Oct 03 14:58:55.715801 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Connection: close Oct 03 14:58:55.715801 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Length: 0 Oct 03 14:58:55.715801 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Type: application/json Oct 03 14:58:55.715801 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Host: 10.222.0.46 Oct 03 14:58:55.715801 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Openstack-System-Scope: None Oct 03 14:58:55.715801 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: User-Agent: python-urllib3/1.26.12 Oct 03 14:58:55.715801 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Auth-Token: gAAAAABjOvcVbKiHnNy90WglqYe5Q1MwexWf6mCQgnW_RoYIDHCKZyjYComPW_WJfpkmYdPGmBh_lHytVTlk3gOxTumrJiqzfNInV4R1Rg-YBW8I7tzJMuPKobbPL6KZa8sK-WadPvCsNgL3ob2ccjWgfOhEn-3_ZHmMK9Tu9uRhH_3sf5LyZ5o Oct 03 14:58:55.715801 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Id: None Oct 03 14:58:55.715801 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Name: None Oct 03 14:58:55.715801 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Identity-Status: Confirmed Oct 03 14:58:55.715801 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Is-Admin-Project: True Oct 03 14:58:55.715801 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Id: default Oct 03 14:58:55.715801 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Name: Default Oct 03 14:58:55.715801 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Id: 83b495f3cb9b437d9572f4d33327fbf7 Oct 03 14:58:55.715801 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-685876426 Oct 03 14:58:55.715801 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Role: member,reader Oct 03 14:58:55.715801 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Roles: member,reader Oct 03 14:58:55.717372 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/83b495f3cb9b437d9572f4d33327fbf7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_83b495f3cb9b437d9572f4d33327fbf7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/83b495f3cb9b437d9572f4d33327fbf7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/83b495f3cb9b437d9572f4d33327fbf7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 14:58:55.717372 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant: tempest-ServerRescueNegativeTestJSON-685876426 Oct 03 14:58:55.717372 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Id: 83b495f3cb9b437d9572f4d33327fbf7 Oct 03 14:58:55.717372 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-685876426 Oct 03 14:58:55.717372 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User: tempest-ServerRescueNegativeTestJSON-685876426-project Oct 03 14:58:55.717372 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Id: default Oct 03 14:58:55.717372 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Name: Default Oct 03 14:58:55.717372 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Id: 335dd8706d4c402e98605479b57d059a Oct 03 14:58:55.717372 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Name: tempest-ServerRescueNegativeTestJSON-685876426-project Oct 03 14:58:55.717372 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: method: > Oct 03 14:58:55.717372 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: exception: Instance 3a42b833-728b-44e8-af21-fe86e25c035f could not be found. Oct 03 14:58:55.717372 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: action_args: {'id': '3a42b833-728b-44e8-af21-fe86e25c035f'} Oct 03 14:58:55.718705 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:58:55.718705 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:55.718705 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:58:55.718705 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:58:55.718705 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:58:55.718705 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:58:55.718705 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:58:55.718705 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:58:55.718705 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:58:55.718705 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:58:55.718705 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a42b833-728b-44e8-af21-fe86e25c035f could not be found. Oct 03 14:58:55.718705 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:58:55.718705 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:58:55.718705 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:58:55.718705 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:55.718705 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:58:55.718705 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:58:55.718705 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:58:55.718705 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:58:55.718705 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:58:55.720230 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:58:55.720230 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:58:55.720230 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:58:55.720230 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:58:55.720230 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:58:55.720230 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:58:55.720230 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:58:55.720230 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a42b833-728b-44e8-af21-fe86e25c035f could not be found. Oct 03 14:58:55.720230 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:58:55.720230 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:58:55.720230 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:58:55.720230 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:55.720230 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:58:55.720230 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:58:55.720230 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:58:55.720230 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:58:55.720230 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a42b833-728b-44e8-af21-fe86e25c035f could not be found. Oct 03 14:58:55.720230 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:58:55.721486 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-1d426c77-365a-4310-a520-e14d5e3d8eed tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Returning 404 to user: Instance 3a42b833-728b-44e8-af21-fe86e25c035f could not be found. {{(pid=126852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:58:55.721486 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-1d426c77-365a-4310-a520-e14d5e3d8eed tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f" status: 404 len: 111 microversion: 2.1 time: 0.030065 Oct 03 14:58:55.721486 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 357/749] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:55 2022] GET /compute/v2.1/servers/3a42b833-728b-44e8-af21-fe86e25c035f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:58:55.726136 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-ec1d6a9a-9a9e-4e9a-84d1-dffdc7bf0cb4 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '.version_select at 0x7fe0d6d099d0>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:55.745349 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-ec1d6a9a-9a9e-4e9a-84d1-dffdc7bf0cb4 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1928876236" status: 202 len: 0 microversion: 2.1 time: 0.022880 Oct 03 14:58:55.745935 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 393/750] 10.222.0.46 () {58 vars in 1221 bytes} [Mon Oct 3 14:58:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1928876236 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:58:58.581392 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-06e24b5e-ec93-43a0-be23-930c3ac357f8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:58.581920 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-06e24b5e-ec93-43a0-be23-930c3ac357f8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:58.589002 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-06e24b5e-ec93-43a0-be23-930c3ac357f8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:58.589484 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-06e24b5e-ec93-43a0-be23-930c3ac357f8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:58.590015 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-06e24b5e-ec93-43a0-be23-930c3ac357f8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:58.590704 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-06e24b5e-ec93-43a0-be23-930c3ac357f8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:58.591160 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-06e24b5e-ec93-43a0-be23-930c3ac357f8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:58.591584 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-06e24b5e-ec93-43a0-be23-930c3ac357f8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:58.617152 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-06e24b5e-ec93-43a0-be23-930c3ac357f8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Going to try to terminate instance {{(pid=126852) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:58:58.689107 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-06e24b5e-ec93-43a0-be23-930c3ac357f8 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "DELETE /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 204 len: 0 microversion: 2.1 time: 0.111258 Oct 03 14:58:58.690075 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 358/751] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 3 14:58:58 2022] DELETE /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:58:58.698254 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-c27a3f41-8ccb-4483-b3f9-c48f676b1ed0 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:58.698871 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-c27a3f41-8ccb-4483-b3f9-c48f676b1ed0 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:58.706141 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c27a3f41-8ccb-4483-b3f9-c48f676b1ed0 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:58.706626 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c27a3f41-8ccb-4483-b3f9-c48f676b1ed0 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:58.707063 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c27a3f41-8ccb-4483-b3f9-c48f676b1ed0 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:58.707752 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c27a3f41-8ccb-4483-b3f9-c48f676b1ed0 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:58.708208 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c27a3f41-8ccb-4483-b3f9-c48f676b1ed0 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:58.708635 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c27a3f41-8ccb-4483-b3f9-c48f676b1ed0 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:58.832668 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-c27a3f41-8ccb-4483-b3f9-c48f676b1ed0 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:58.840607 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-c27a3f41-8ccb-4483-b3f9-c48f676b1ed0 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1507 microversion: 2.1 time: 0.146625 Oct 03 14:58:58.841160 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 394/752] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:58 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1507 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:59.864892 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-8983fceb-e868-4f44-8ee6-68524d1b3449 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:59.865605 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-8983fceb-e868-4f44-8ee6-68524d1b3449 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:59.871489 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8983fceb-e868-4f44-8ee6-68524d1b3449 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:59.871970 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8983fceb-e868-4f44-8ee6-68524d1b3449 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:59.872404 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8983fceb-e868-4f44-8ee6-68524d1b3449 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:59.873094 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8983fceb-e868-4f44-8ee6-68524d1b3449 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:59.874151 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8983fceb-e868-4f44-8ee6-68524d1b3449 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:59.874584 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8983fceb-e868-4f44-8ee6-68524d1b3449 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:00.010439 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-8983fceb-e868-4f44-8ee6-68524d1b3449 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:00.018006 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-8983fceb-e868-4f44-8ee6-68524d1b3449 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1507 microversion: 2.1 time: 0.157272 Oct 03 14:59:00.018578 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 359/753] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:59 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:00.088284 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-df8aeca7-a0b0-46c7-8f90-dabac33cd1f5 req-caecadb6-109e-4583-ad20-cfbea7791b22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "193f7fe8-5737-49b3-a165-4345f3357042", "name": "network-vif-deleted", "tag": "06e443b0-42ce-487b-9e0c-244828a5e40e"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:59:00.099477 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-df8aeca7-a0b0-46c7-8f90-dabac33cd1f5 req-caecadb6-109e-4583-ad20-cfbea7791b22 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:00.099963 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-df8aeca7-a0b0-46c7-8f90-dabac33cd1f5 req-caecadb6-109e-4583-ad20-cfbea7791b22 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:00.100406 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-df8aeca7-a0b0-46c7-8f90-dabac33cd1f5 req-caecadb6-109e-4583-ad20-cfbea7791b22 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:00.113811 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-df8aeca7-a0b0-46c7-8f90-dabac33cd1f5 req-caecadb6-109e-4583-ad20-cfbea7791b22 service nova] Creating event network-vif-deleted:06e443b0-42ce-487b-9e0c-244828a5e40e for instance 193f7fe8-5737-49b3-a165-4345f3357042 on hv-cinder-85987 Oct 03 14:59:00.118834 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-df8aeca7-a0b0-46c7-8f90-dabac33cd1f5 req-caecadb6-109e-4583-ad20-cfbea7791b22 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034132 Oct 03 14:59:00.119915 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 395/754] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:59:01.041110 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-55515de9-9b20-499c-b41f-b9dccaef683b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:01.041746 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-55515de9-9b20-499c-b41f-b9dccaef683b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:01.048137 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-55515de9-9b20-499c-b41f-b9dccaef683b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:01.048622 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-55515de9-9b20-499c-b41f-b9dccaef683b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:01.049062 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-55515de9-9b20-499c-b41f-b9dccaef683b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:01.049782 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-55515de9-9b20-499c-b41f-b9dccaef683b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:01.050238 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-55515de9-9b20-499c-b41f-b9dccaef683b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:01.050661 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-55515de9-9b20-499c-b41f-b9dccaef683b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:01.082833 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-55515de9-9b20-499c-b41f-b9dccaef683b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:01.083317 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-55515de9-9b20-499c-b41f-b9dccaef683b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:01.084027 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-55515de9-9b20-499c-b41f-b9dccaef683b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:01.084469 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.objects.instance [None req-55515de9-9b20-499c-b41f-b9dccaef683b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lazy-loading 'fault' on Instance uuid 193f7fe8-5737-49b3-a165-4345f3357042 {{(pid=126852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:59:01.123350 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-55515de9-9b20-499c-b41f-b9dccaef683b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:01.131919 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-55515de9-9b20-499c-b41f-b9dccaef683b tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 200 len: 1311 microversion: 2.1 time: 0.094571 Oct 03 14:59:01.132478 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 360/755] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:01 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:01.490665 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-58339bed-108b-493b-a2c3-a38e3c0ecbc3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:59:01.491289 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-58339bed-108b-493b-a2c3-a38e3c0ecbc3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:01.497512 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-58339bed-108b-493b-a2c3-a38e3c0ecbc3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:01.498022 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-58339bed-108b-493b-a2c3-a38e3c0ecbc3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:01.499090 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-58339bed-108b-493b-a2c3-a38e3c0ecbc3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:01.499947 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-58339bed-108b-493b-a2c3-a38e3c0ecbc3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:01.500409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-58339bed-108b-493b-a2c3-a38e3c0ecbc3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:01.500838 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-58339bed-108b-493b-a2c3-a38e3c0ecbc3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:01.523292 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.objects.instance [None req-58339bed-108b-493b-a2c3-a38e3c0ecbc3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lazy-loading 'flavor' on Instance uuid fe4e9466-74aa-4df2-8a80-8c79b26bc20e {{(pid=126851) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:59:01.594018 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-58339bed-108b-493b-a2c3-a38e3c0ecbc3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "POST /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e/action" status: 202 len: 0 microversion: 2.1 time: 0.107910 Oct 03 14:59:01.594608 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 396/756] 10.222.0.46 () {60 vars in 1278 bytes} [Mon Oct 3 14:59:01 2022] POST /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:59:01.602668 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-75db283a-5a2d-431a-ad1e-c0f6809a8d5c tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:01.603274 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-75db283a-5a2d-431a-ad1e-c0f6809a8d5c tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:01.609736 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-75db283a-5a2d-431a-ad1e-c0f6809a8d5c tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:01.610240 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-75db283a-5a2d-431a-ad1e-c0f6809a8d5c tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:01.610669 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-75db283a-5a2d-431a-ad1e-c0f6809a8d5c tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:01.611353 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-75db283a-5a2d-431a-ad1e-c0f6809a8d5c tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:01.611802 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-75db283a-5a2d-431a-ad1e-c0f6809a8d5c tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:01.612223 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-75db283a-5a2d-431a-ad1e-c0f6809a8d5c tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:01.741469 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-75db283a-5a2d-431a-ad1e-c0f6809a8d5c tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:01.749229 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-75db283a-5a2d-431a-ad1e-c0f6809a8d5c tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1565 microversion: 2.1 time: 0.150281 Oct 03 14:59:01.749824 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 361/757] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:01 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:02.156109 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-54142ff4-ad8b-44b8-8bc1-c5e266c7db82 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:02.156801 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-54142ff4-ad8b-44b8-8bc1-c5e266c7db82 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 193f7fe8-5737-49b3-a165-4345f3357042] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:02.162909 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-54142ff4-ad8b-44b8-8bc1-c5e266c7db82 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:02.163392 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-54142ff4-ad8b-44b8-8bc1-c5e266c7db82 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:02.163826 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-54142ff4-ad8b-44b8-8bc1-c5e266c7db82 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:02.164511 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-54142ff4-ad8b-44b8-8bc1-c5e266c7db82 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:02.164964 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-54142ff4-ad8b-44b8-8bc1-c5e266c7db82 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:02.165389 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-54142ff4-ad8b-44b8-8bc1-c5e266c7db82 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:02.178315 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.wsgi [None req-54142ff4-ad8b-44b8-8bc1-c5e266c7db82 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] HTTP exception thrown: Instance 193f7fe8-5737-49b3-a165-4345f3357042 could not be found. Oct 03 14:59:02.179871 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-54142ff4-ad8b-44b8-8bc1-c5e266c7db82 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Request method failure captured: Oct 03 14:59:02.179871 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: request: GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 HTTP/1.1 Oct 03 14:59:02.179871 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept: application/json Oct 03 14:59:02.179871 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept-Encoding: identity Oct 03 14:59:02.179871 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Connection: close Oct 03 14:59:02.179871 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Length: 0 Oct 03 14:59:02.179871 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Type: application/json Oct 03 14:59:02.179871 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Host: 10.222.0.46 Oct 03 14:59:02.179871 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Openstack-System-Scope: None Oct 03 14:59:02.179871 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: User-Agent: python-urllib3/1.26.12 Oct 03 14:59:02.179871 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Auth-Token: gAAAAABjOvcVbKiHnNy90WglqYe5Q1MwexWf6mCQgnW_RoYIDHCKZyjYComPW_WJfpkmYdPGmBh_lHytVTlk3gOxTumrJiqzfNInV4R1Rg-YBW8I7tzJMuPKobbPL6KZa8sK-WadPvCsNgL3ob2ccjWgfOhEn-3_ZHmMK9Tu9uRhH_3sf5LyZ5o Oct 03 14:59:02.179871 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Id: None Oct 03 14:59:02.179871 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Name: None Oct 03 14:59:02.179871 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Identity-Status: Confirmed Oct 03 14:59:02.179871 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Is-Admin-Project: True Oct 03 14:59:02.179871 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Id: default Oct 03 14:59:02.179871 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Name: Default Oct 03 14:59:02.179871 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Id: 83b495f3cb9b437d9572f4d33327fbf7 Oct 03 14:59:02.179871 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-685876426 Oct 03 14:59:02.179871 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Role: member,reader Oct 03 14:59:02.179871 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Roles: member,reader Oct 03 14:59:02.181403 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/83b495f3cb9b437d9572f4d33327fbf7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_83b495f3cb9b437d9572f4d33327fbf7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/83b495f3cb9b437d9572f4d33327fbf7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/83b495f3cb9b437d9572f4d33327fbf7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 14:59:02.181403 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant: tempest-ServerRescueNegativeTestJSON-685876426 Oct 03 14:59:02.181403 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Id: 83b495f3cb9b437d9572f4d33327fbf7 Oct 03 14:59:02.181403 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-685876426 Oct 03 14:59:02.181403 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User: tempest-ServerRescueNegativeTestJSON-685876426-project Oct 03 14:59:02.181403 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Id: default Oct 03 14:59:02.181403 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Name: Default Oct 03 14:59:02.181403 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Id: 335dd8706d4c402e98605479b57d059a Oct 03 14:59:02.181403 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Name: tempest-ServerRescueNegativeTestJSON-685876426-project Oct 03 14:59:02.181403 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: method: > Oct 03 14:59:02.181403 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: exception: Instance 193f7fe8-5737-49b3-a165-4345f3357042 could not be found. Oct 03 14:59:02.181403 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: action_args: {'id': '193f7fe8-5737-49b3-a165-4345f3357042'} Oct 03 14:59:02.182381 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:59:02.182381 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:02.182381 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:59:02.182381 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:59:02.182381 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:59:02.182381 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:59:02.182381 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:59:02.182381 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:59:02.182381 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:59:02.182381 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:59:02.182381 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 193f7fe8-5737-49b3-a165-4345f3357042 could not be found. Oct 03 14:59:02.182381 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:59:02.182381 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:02.182381 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:59:02.182381 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:02.182381 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:59:02.182381 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:59:02.182381 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:59:02.182381 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:59:02.182381 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:59:02.183788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:59:02.183788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:59:02.183788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:59:02.183788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:59:02.183788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:59:02.183788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:59:02.183788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:59:02.183788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 193f7fe8-5737-49b3-a165-4345f3357042 could not be found. Oct 03 14:59:02.183788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:59:02.183788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:02.183788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:59:02.183788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:02.183788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:59:02.183788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:59:02.183788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:59:02.183788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:59:02.183788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 193f7fe8-5737-49b3-a165-4345f3357042 could not be found. Oct 03 14:59:02.183788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:59:02.185403 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-54142ff4-ad8b-44b8-8bc1-c5e266c7db82 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Returning 404 to user: Instance 193f7fe8-5737-49b3-a165-4345f3357042 could not be found. {{(pid=126851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:59:02.185403 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-54142ff4-ad8b-44b8-8bc1-c5e266c7db82 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042" status: 404 len: 111 microversion: 2.1 time: 0.029939 Oct 03 14:59:02.185403 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 397/758] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:02 2022] GET /compute/v2.1/servers/193f7fe8-5737-49b3-a165-4345f3357042 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:59:02.189752 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-0edeacce-66f4-4d70-a637-62e5b88faa7e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:02.190246 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-0edeacce-66f4-4d70-a637-62e5b88faa7e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:02.196689 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0edeacce-66f4-4d70-a637-62e5b88faa7e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:02.197169 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0edeacce-66f4-4d70-a637-62e5b88faa7e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:02.197665 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0edeacce-66f4-4d70-a637-62e5b88faa7e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:02.198348 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0edeacce-66f4-4d70-a637-62e5b88faa7e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:02.198797 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0edeacce-66f4-4d70-a637-62e5b88faa7e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:02.199218 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0edeacce-66f4-4d70-a637-62e5b88faa7e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:02.224923 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-0edeacce-66f4-4d70-a637-62e5b88faa7e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Going to try to terminate instance {{(pid=126852) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:59:02.301240 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-0edeacce-66f4-4d70-a637-62e5b88faa7e tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "DELETE /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3" status: 204 len: 0 microversion: 2.1 time: 0.114804 Oct 03 14:59:02.302337 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 362/759] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 3 14:59:02 2022] DELETE /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:59:02.310847 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-f2e2186a-25ae-4141-8a86-5f26f34556e4 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:02.311944 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-f2e2186a-25ae-4141-8a86-5f26f34556e4 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:02.317840 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f2e2186a-25ae-4141-8a86-5f26f34556e4 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:02.318315 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f2e2186a-25ae-4141-8a86-5f26f34556e4 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:02.318746 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f2e2186a-25ae-4141-8a86-5f26f34556e4 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:02.319425 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f2e2186a-25ae-4141-8a86-5f26f34556e4 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:02.319872 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f2e2186a-25ae-4141-8a86-5f26f34556e4 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:02.320288 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f2e2186a-25ae-4141-8a86-5f26f34556e4 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:02.445240 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-f2e2186a-25ae-4141-8a86-5f26f34556e4 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:02.453399 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-f2e2186a-25ae-4141-8a86-5f26f34556e4 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3" status: 200 len: 1523 microversion: 2.1 time: 0.146975 Oct 03 14:59:02.453983 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 398/760] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:02 2022] GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3 => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:02.772908 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-7c1944c9-b51c-4678-a657-7bcf2c3428c7 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:02.773536 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-7c1944c9-b51c-4678-a657-7bcf2c3428c7 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:02.779511 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7c1944c9-b51c-4678-a657-7bcf2c3428c7 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:02.780035 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7c1944c9-b51c-4678-a657-7bcf2c3428c7 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:02.780471 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7c1944c9-b51c-4678-a657-7bcf2c3428c7 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:02.781164 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7c1944c9-b51c-4678-a657-7bcf2c3428c7 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:02.781646 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7c1944c9-b51c-4678-a657-7bcf2c3428c7 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:02.782074 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7c1944c9-b51c-4678-a657-7bcf2c3428c7 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:02.911859 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-7c1944c9-b51c-4678-a657-7bcf2c3428c7 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:02.919526 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-7c1944c9-b51c-4678-a657-7bcf2c3428c7 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1565 microversion: 2.1 time: 0.150905 Oct 03 14:59:02.920092 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 363/761] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:02 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:03.476188 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-2f4bf0f9-a291-49df-959b-3993cf3f3836 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:03.476795 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-2f4bf0f9-a291-49df-959b-3993cf3f3836 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:03.483211 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2f4bf0f9-a291-49df-959b-3993cf3f3836 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:03.483692 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2f4bf0f9-a291-49df-959b-3993cf3f3836 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:03.484127 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2f4bf0f9-a291-49df-959b-3993cf3f3836 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:03.484804 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2f4bf0f9-a291-49df-959b-3993cf3f3836 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:03.485260 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2f4bf0f9-a291-49df-959b-3993cf3f3836 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:03.485714 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2f4bf0f9-a291-49df-959b-3993cf3f3836 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:03.612497 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-2f4bf0f9-a291-49df-959b-3993cf3f3836 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:03.620106 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-2f4bf0f9-a291-49df-959b-3993cf3f3836 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3" status: 200 len: 1523 microversion: 2.1 time: 0.147845 Oct 03 14:59:03.620673 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 399/762] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:03 2022] GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:03.942950 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-a367d8a4-79ca-41ad-ba2e-fa50a2a1e745 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:03.943564 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-a367d8a4-79ca-41ad-ba2e-fa50a2a1e745 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:03.949905 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a367d8a4-79ca-41ad-ba2e-fa50a2a1e745 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:03.950389 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a367d8a4-79ca-41ad-ba2e-fa50a2a1e745 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:03.950828 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a367d8a4-79ca-41ad-ba2e-fa50a2a1e745 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:03.952134 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a367d8a4-79ca-41ad-ba2e-fa50a2a1e745 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:03.952592 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a367d8a4-79ca-41ad-ba2e-fa50a2a1e745 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:03.953022 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a367d8a4-79ca-41ad-ba2e-fa50a2a1e745 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:04.085295 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-a367d8a4-79ca-41ad-ba2e-fa50a2a1e745 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:04.093054 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-a367d8a4-79ca-41ad-ba2e-fa50a2a1e745 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1565 microversion: 2.1 time: 0.153880 Oct 03 14:59:04.093677 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 364/763] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:03 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:04.642879 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-4cd137c0-82c4-43fc-9f54-d98b46eaa811 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:04.643430 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-4cd137c0-82c4-43fc-9f54-d98b46eaa811 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:04.650100 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4cd137c0-82c4-43fc-9f54-d98b46eaa811 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:04.650579 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4cd137c0-82c4-43fc-9f54-d98b46eaa811 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:04.651036 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4cd137c0-82c4-43fc-9f54-d98b46eaa811 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:04.651720 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4cd137c0-82c4-43fc-9f54-d98b46eaa811 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:04.652170 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4cd137c0-82c4-43fc-9f54-d98b46eaa811 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:04.652585 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4cd137c0-82c4-43fc-9f54-d98b46eaa811 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:04.777280 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-4cd137c0-82c4-43fc-9f54-d98b46eaa811 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:04.780082 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:59:04.787074 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-4cd137c0-82c4-43fc-9f54-d98b46eaa811 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3" status: 200 len: 1523 microversion: 2.1 time: 0.148108 Oct 03 14:59:04.787656 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 400/764] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:04 2022] GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:05.116053 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-78255b87-97a4-4a29-9cda-d126d63dde25 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:05.116669 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-78255b87-97a4-4a29-9cda-d126d63dde25 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:05.124237 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-78255b87-97a4-4a29-9cda-d126d63dde25 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:05.124726 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-78255b87-97a4-4a29-9cda-d126d63dde25 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:05.125163 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-78255b87-97a4-4a29-9cda-d126d63dde25 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:05.125892 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-78255b87-97a4-4a29-9cda-d126d63dde25 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:05.126351 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-78255b87-97a4-4a29-9cda-d126d63dde25 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:05.126777 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-78255b87-97a4-4a29-9cda-d126d63dde25 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:05.131135 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:59:05.265776 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-78255b87-97a4-4a29-9cda-d126d63dde25 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:05.275228 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-78255b87-97a4-4a29-9cda-d126d63dde25 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1565 microversion: 2.1 time: 0.162913 Oct 03 14:59:05.276042 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 365/765] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:05 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:05.660327 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-42860cb8-cca3-432a-8f7b-6083272191e9 req-1098b0aa-d335-4f06-b346-6a46565a358d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93eb4038-8732-40ab-b4ff-b9ba16dab3f3", "name": "network-vif-deleted", "tag": "d7ceaf30-9e00-432b-b831-684569089003"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:59:05.671172 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:59:05.673055 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-42860cb8-cca3-432a-8f7b-6083272191e9 req-1098b0aa-d335-4f06-b346-6a46565a358d service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:05.673612 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-42860cb8-cca3-432a-8f7b-6083272191e9 req-1098b0aa-d335-4f06-b346-6a46565a358d service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:05.674282 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-42860cb8-cca3-432a-8f7b-6083272191e9 req-1098b0aa-d335-4f06-b346-6a46565a358d service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:05.700757 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-42860cb8-cca3-432a-8f7b-6083272191e9 req-1098b0aa-d335-4f06-b346-6a46565a358d service nova] Creating event network-vif-deleted:d7ceaf30-9e00-432b-b831-684569089003 for instance 93eb4038-8732-40ab-b4ff-b9ba16dab3f3 on hv-cinder-85987 Oct 03 14:59:05.710593 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-42860cb8-cca3-432a-8f7b-6083272191e9 req-1098b0aa-d335-4f06-b346-6a46565a358d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054022 Oct 03 14:59:05.711493 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 401/766] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:59:05.809753 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-78a2e6e7-306d-4d18-9b00-9d2f0bd1c0ad tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:05.810478 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-78a2e6e7-306d-4d18-9b00-9d2f0bd1c0ad tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:05.817857 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-78a2e6e7-306d-4d18-9b00-9d2f0bd1c0ad tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:05.818355 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-78a2e6e7-306d-4d18-9b00-9d2f0bd1c0ad tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:05.818796 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-78a2e6e7-306d-4d18-9b00-9d2f0bd1c0ad tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:05.819504 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-78a2e6e7-306d-4d18-9b00-9d2f0bd1c0ad tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:05.819965 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-78a2e6e7-306d-4d18-9b00-9d2f0bd1c0ad tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:05.820391 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-78a2e6e7-306d-4d18-9b00-9d2f0bd1c0ad tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:05.852626 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-78a2e6e7-306d-4d18-9b00-9d2f0bd1c0ad tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:05.853123 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-78a2e6e7-306d-4d18-9b00-9d2f0bd1c0ad tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:05.853590 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-78a2e6e7-306d-4d18-9b00-9d2f0bd1c0ad tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:05.854052 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.objects.instance [None req-78a2e6e7-306d-4d18-9b00-9d2f0bd1c0ad tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lazy-loading 'fault' on Instance uuid 93eb4038-8732-40ab-b4ff-b9ba16dab3f3 {{(pid=126852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:59:05.902350 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-78a2e6e7-306d-4d18-9b00-9d2f0bd1c0ad tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335dd8706d4c402e98605479b57d059a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b495f3cb9b437d9572f4d33327fbf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:05.910598 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-78a2e6e7-306d-4d18-9b00-9d2f0bd1c0ad tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3" status: 200 len: 1312 microversion: 2.1 time: 0.104727 Oct 03 14:59:05.911473 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 366/767] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:05 2022] GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3 => generated 1312 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:06.300489 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-ea0ac4a9-13df-48bb-b37d-7c68b65247e3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:06.301186 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-ea0ac4a9-13df-48bb-b37d-7c68b65247e3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:06.307567 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ea0ac4a9-13df-48bb-b37d-7c68b65247e3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:06.308046 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ea0ac4a9-13df-48bb-b37d-7c68b65247e3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:06.308478 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ea0ac4a9-13df-48bb-b37d-7c68b65247e3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:06.309170 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ea0ac4a9-13df-48bb-b37d-7c68b65247e3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:06.309658 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ea0ac4a9-13df-48bb-b37d-7c68b65247e3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:06.310082 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ea0ac4a9-13df-48bb-b37d-7c68b65247e3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:06.449677 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-ea0ac4a9-13df-48bb-b37d-7c68b65247e3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:06.458742 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-ea0ac4a9-13df-48bb-b37d-7c68b65247e3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1565 microversion: 2.1 time: 0.163271 Oct 03 14:59:06.459314 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 402/768] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:06 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:06.936649 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-2bd2432e-e24b-4de5-80af-a1f9e63413d9 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:06.937616 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-2bd2432e-e24b-4de5-80af-a1f9e63413d9 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] [instance: 93eb4038-8732-40ab-b4ff-b9ba16dab3f3] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:06.945564 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2bd2432e-e24b-4de5-80af-a1f9e63413d9 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:06.946053 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2bd2432e-e24b-4de5-80af-a1f9e63413d9 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:06.946502 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2bd2432e-e24b-4de5-80af-a1f9e63413d9 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:06.947196 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2bd2432e-e24b-4de5-80af-a1f9e63413d9 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:06.947648 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2bd2432e-e24b-4de5-80af-a1f9e63413d9 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:06.948104 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2bd2432e-e24b-4de5-80af-a1f9e63413d9 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:06.962560 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.wsgi [None req-2bd2432e-e24b-4de5-80af-a1f9e63413d9 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] HTTP exception thrown: Instance 93eb4038-8732-40ab-b4ff-b9ba16dab3f3 could not be found. Oct 03 14:59:06.964214 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-2bd2432e-e24b-4de5-80af-a1f9e63413d9 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Request method failure captured: Oct 03 14:59:06.964214 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: request: GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3 HTTP/1.1 Oct 03 14:59:06.964214 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept: application/json Oct 03 14:59:06.964214 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept-Encoding: identity Oct 03 14:59:06.964214 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Connection: close Oct 03 14:59:06.964214 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Length: 0 Oct 03 14:59:06.964214 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Type: application/json Oct 03 14:59:06.964214 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Host: 10.222.0.46 Oct 03 14:59:06.964214 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Openstack-System-Scope: None Oct 03 14:59:06.964214 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: User-Agent: python-urllib3/1.26.12 Oct 03 14:59:06.964214 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Auth-Token: gAAAAABjOvcVbKiHnNy90WglqYe5Q1MwexWf6mCQgnW_RoYIDHCKZyjYComPW_WJfpkmYdPGmBh_lHytVTlk3gOxTumrJiqzfNInV4R1Rg-YBW8I7tzJMuPKobbPL6KZa8sK-WadPvCsNgL3ob2ccjWgfOhEn-3_ZHmMK9Tu9uRhH_3sf5LyZ5o Oct 03 14:59:06.964214 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Id: None Oct 03 14:59:06.964214 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Name: None Oct 03 14:59:06.964214 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Identity-Status: Confirmed Oct 03 14:59:06.964214 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Is-Admin-Project: True Oct 03 14:59:06.964214 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Id: default Oct 03 14:59:06.964214 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Name: Default Oct 03 14:59:06.964214 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Id: 83b495f3cb9b437d9572f4d33327fbf7 Oct 03 14:59:06.964214 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-685876426 Oct 03 14:59:06.964214 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Role: member,reader Oct 03 14:59:06.964214 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Roles: member,reader Oct 03 14:59:06.965626 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/83b495f3cb9b437d9572f4d33327fbf7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_83b495f3cb9b437d9572f4d33327fbf7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/83b495f3cb9b437d9572f4d33327fbf7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/83b495f3cb9b437d9572f4d33327fbf7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 14:59:06.965626 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant: tempest-ServerRescueNegativeTestJSON-685876426 Oct 03 14:59:06.965626 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Id: 83b495f3cb9b437d9572f4d33327fbf7 Oct 03 14:59:06.965626 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-685876426 Oct 03 14:59:06.965626 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User: tempest-ServerRescueNegativeTestJSON-685876426-project Oct 03 14:59:06.965626 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Id: default Oct 03 14:59:06.965626 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Name: Default Oct 03 14:59:06.965626 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Id: 335dd8706d4c402e98605479b57d059a Oct 03 14:59:06.965626 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Name: tempest-ServerRescueNegativeTestJSON-685876426-project Oct 03 14:59:06.965626 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: method: > Oct 03 14:59:06.965626 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: exception: Instance 93eb4038-8732-40ab-b4ff-b9ba16dab3f3 could not be found. Oct 03 14:59:06.965626 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: action_args: {'id': '93eb4038-8732-40ab-b4ff-b9ba16dab3f3'} Oct 03 14:59:06.966380 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:59:06.966380 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:06.966380 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:59:06.966380 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:59:06.966380 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:59:06.966380 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:59:06.966380 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:59:06.966380 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:59:06.966380 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:59:06.966380 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:59:06.966380 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93eb4038-8732-40ab-b4ff-b9ba16dab3f3 could not be found. Oct 03 14:59:06.966380 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:59:06.966380 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:06.966380 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:59:06.966380 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:06.966380 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:59:06.966380 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:59:06.966380 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:59:06.966380 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:59:06.966380 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:59:06.967843 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:59:06.967843 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:59:06.967843 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:59:06.967843 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:59:06.967843 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:59:06.967843 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:59:06.967843 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:59:06.967843 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93eb4038-8732-40ab-b4ff-b9ba16dab3f3 could not be found. Oct 03 14:59:06.967843 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:59:06.967843 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:06.967843 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:59:06.967843 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:06.967843 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:59:06.967843 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:59:06.967843 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:59:06.967843 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:59:06.967843 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93eb4038-8732-40ab-b4ff-b9ba16dab3f3 could not be found. Oct 03 14:59:06.967843 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:59:06.969168 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-2bd2432e-e24b-4de5-80af-a1f9e63413d9 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] Returning 404 to user: Instance 93eb4038-8732-40ab-b4ff-b9ba16dab3f3 could not be found. {{(pid=126852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:59:06.969168 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-2bd2432e-e24b-4de5-80af-a1f9e63413d9 tempest-ServerRescueNegativeTestJSON-685876426 tempest-ServerRescueNegativeTestJSON-685876426-project] 10.222.0.46 "GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3" status: 404 len: 111 microversion: 2.1 time: 0.035387 Oct 03 14:59:06.969168 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 367/769] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:06 2022] GET /compute/v2.1/servers/93eb4038-8732-40ab-b4ff-b9ba16dab3f3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:59:07.483983 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-8fa31a65-441e-47e6-94e2-db6ec80fcaea tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:07.484636 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-8fa31a65-441e-47e6-94e2-db6ec80fcaea tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:07.491156 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8fa31a65-441e-47e6-94e2-db6ec80fcaea tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:07.491643 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8fa31a65-441e-47e6-94e2-db6ec80fcaea tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:07.492076 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8fa31a65-441e-47e6-94e2-db6ec80fcaea tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:07.492772 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8fa31a65-441e-47e6-94e2-db6ec80fcaea tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:07.493222 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8fa31a65-441e-47e6-94e2-db6ec80fcaea tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:07.493669 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8fa31a65-441e-47e6-94e2-db6ec80fcaea tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:07.918354 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-8fa31a65-441e-47e6-94e2-db6ec80fcaea tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:07.926611 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-8fa31a65-441e-47e6-94e2-db6ec80fcaea tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1565 microversion: 2.1 time: 0.446990 Oct 03 14:59:07.927171 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 403/770] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:07 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1565 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:08.950032 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-da505b99-9b7c-4d91-a750-ba8ee7553bb6 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:08.950682 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-da505b99-9b7c-4d91-a750-ba8ee7553bb6 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:08.958143 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-da505b99-9b7c-4d91-a750-ba8ee7553bb6 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:08.958884 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-da505b99-9b7c-4d91-a750-ba8ee7553bb6 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:08.959521 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-da505b99-9b7c-4d91-a750-ba8ee7553bb6 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:08.960227 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-da505b99-9b7c-4d91-a750-ba8ee7553bb6 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:08.960690 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-da505b99-9b7c-4d91-a750-ba8ee7553bb6 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:08.961237 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-da505b99-9b7c-4d91-a750-ba8ee7553bb6 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:09.103314 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-da505b99-9b7c-4d91-a750-ba8ee7553bb6 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:09.111590 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-da505b99-9b7c-4d91-a750-ba8ee7553bb6 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1565 microversion: 2.1 time: 0.165561 Oct 03 14:59:09.112320 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 368/771] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:08 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:10.135903 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-15a53fbd-4989-4204-ab72-1ce0cec18eb4 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:10.136428 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-15a53fbd-4989-4204-ab72-1ce0cec18eb4 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:10.142724 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-15a53fbd-4989-4204-ab72-1ce0cec18eb4 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:10.143220 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-15a53fbd-4989-4204-ab72-1ce0cec18eb4 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:10.143709 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-15a53fbd-4989-4204-ab72-1ce0cec18eb4 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:10.144361 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-15a53fbd-4989-4204-ab72-1ce0cec18eb4 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:10.144815 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-15a53fbd-4989-4204-ab72-1ce0cec18eb4 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:10.145245 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-15a53fbd-4989-4204-ab72-1ce0cec18eb4 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:10.302847 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-15a53fbd-4989-4204-ab72-1ce0cec18eb4 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:10.323947 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-15a53fbd-4989-4204-ab72-1ce0cec18eb4 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1565 microversion: 2.1 time: 0.191896 Oct 03 14:59:10.325351 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 404/772] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:10 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1565 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:11.350640 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-d7faaf00-db51-41c4-af77-9a770265628f tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:11.351267 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-d7faaf00-db51-41c4-af77-9a770265628f tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:11.357585 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d7faaf00-db51-41c4-af77-9a770265628f tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:11.358074 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d7faaf00-db51-41c4-af77-9a770265628f tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:11.358513 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d7faaf00-db51-41c4-af77-9a770265628f tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:11.359208 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d7faaf00-db51-41c4-af77-9a770265628f tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:11.359660 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d7faaf00-db51-41c4-af77-9a770265628f tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:11.360089 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d7faaf00-db51-41c4-af77-9a770265628f tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:11.459264 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-922ec807-101a-4bfd-a564-b38c6eb00fc4 tempest-VolumesGetTestJSON-161728281 tempest-VolumesGetTestJSON-161728281-project] Action: 'create', calling method: .version_select at 0x7fe0d356db80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1320083551", "metadata": {"Type": "work"}}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:59:11.489275 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-d7faaf00-db51-41c4-af77-9a770265628f tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:11.497165 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-d7faaf00-db51-41c4-af77-9a770265628f tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1565 microversion: 2.1 time: 0.150390 Oct 03 14:59:11.497798 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 405/773] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:11 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:59:11.746052 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-922ec807-101a-4bfd-a564-b38c6eb00fc4 tempest-VolumesGetTestJSON-161728281 tempest-VolumesGetTestJSON-161728281-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.400584 Oct 03 14:59:11.755244 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 369/774] 10.222.0.46 () {60 vars in 1156 bytes} [Mon Oct 3 14:59:11 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 402 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 03 14:59:11.760324 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-bf274a37-f7d4-4469-adef-f11a57faa5e3 tempest-VolumesGetTestJSON-161728281 tempest-VolumesGetTestJSON-161728281-project] Calling method '.version_select at 0x7fe0d6cb04c0>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:11.809119 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-bf274a37-f7d4-4469-adef-f11a57faa5e3 tempest-VolumesGetTestJSON-161728281 tempest-VolumesGetTestJSON-161728281-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/9f61c946-505a-4cc7-a60f-dbdefb1c0809" status: 200 len: 353 microversion: 2.1 time: 0.052549 Oct 03 14:59:11.809718 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 406/775] 10.222.0.46 () {58 vars in 1245 bytes} [Mon Oct 3 14:59:11 2022] GET /compute/v2.1/os-volumes/9f61c946-505a-4cc7-a60f-dbdefb1c0809 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:59:12.521201 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-f72c5dcf-2915-4c9d-816b-3812c2d59f49 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:12.521848 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-f72c5dcf-2915-4c9d-816b-3812c2d59f49 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:12.528515 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f72c5dcf-2915-4c9d-816b-3812c2d59f49 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:12.529009 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f72c5dcf-2915-4c9d-816b-3812c2d59f49 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:12.530127 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f72c5dcf-2915-4c9d-816b-3812c2d59f49 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:12.530831 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f72c5dcf-2915-4c9d-816b-3812c2d59f49 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:12.531289 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f72c5dcf-2915-4c9d-816b-3812c2d59f49 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:12.531717 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f72c5dcf-2915-4c9d-816b-3812c2d59f49 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:12.695288 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-f72c5dcf-2915-4c9d-816b-3812c2d59f49 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:12.703717 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-f72c5dcf-2915-4c9d-816b-3812c2d59f49 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1565 microversion: 2.1 time: 0.187006 Oct 03 14:59:12.704278 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 370/776] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:12 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1565 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:12.824681 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-2201a97d-1073-4008-a7ae-7f1044914be3 tempest-VolumesGetTestJSON-161728281 tempest-VolumesGetTestJSON-161728281-project] Calling method '.version_select at 0x7fe0d6c909d0>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:12.870251 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-2201a97d-1073-4008-a7ae-7f1044914be3 tempest-VolumesGetTestJSON-161728281 tempest-VolumesGetTestJSON-161728281-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/9f61c946-505a-4cc7-a60f-dbdefb1c0809" status: 200 len: 354 microversion: 2.1 time: 0.050175 Oct 03 14:59:12.870809 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 407/777] 10.222.0.46 () {58 vars in 1245 bytes} [Mon Oct 3 14:59:12 2022] GET /compute/v2.1/os-volumes/9f61c946-505a-4cc7-a60f-dbdefb1c0809 => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:59:12.883980 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-7de2ffac-bdf6-4580-80c4-81cdc2f60463 tempest-VolumesGetTestJSON-161728281 tempest-VolumesGetTestJSON-161728281-project] Calling method '.version_select at 0x7fe0d33ea0d0>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:12.929479 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-7de2ffac-bdf6-4580-80c4-81cdc2f60463 tempest-VolumesGetTestJSON-161728281 tempest-VolumesGetTestJSON-161728281-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/9f61c946-505a-4cc7-a60f-dbdefb1c0809" status: 200 len: 354 microversion: 2.1 time: 0.049283 Oct 03 14:59:12.930079 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 371/778] 10.222.0.46 () {58 vars in 1245 bytes} [Mon Oct 3 14:59:12 2022] GET /compute/v2.1/os-volumes/9f61c946-505a-4cc7-a60f-dbdefb1c0809 => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:59:12.947789 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-c097fc8d-17a8-428b-9723-96a1a21e5511 tempest-VolumesGetTestJSON-161728281 tempest-VolumesGetTestJSON-161728281-project] Calling method '.version_select at 0x7fe0d3537940>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:13.006019 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-c097fc8d-17a8-428b-9723-96a1a21e5511 tempest-VolumesGetTestJSON-161728281 tempest-VolumesGetTestJSON-161728281-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/9f61c946-505a-4cc7-a60f-dbdefb1c0809" status: 202 len: 0 microversion: 2.1 time: 0.061883 Oct 03 14:59:13.006585 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 408/779] 10.222.0.46 () {58 vars in 1248 bytes} [Mon Oct 3 14:59:12 2022] DELETE /compute/v2.1/os-volumes/9f61c946-505a-4cc7-a60f-dbdefb1c0809 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:59:13.015116 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-ea92825e-96ef-4db9-bfdd-70865d29cfb5 tempest-VolumesGetTestJSON-161728281 tempest-VolumesGetTestJSON-161728281-project] Calling method '.version_select at 0x7fe0d340c9d0>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:13.060957 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-ea92825e-96ef-4db9-bfdd-70865d29cfb5 tempest-VolumesGetTestJSON-161728281 tempest-VolumesGetTestJSON-161728281-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/9f61c946-505a-4cc7-a60f-dbdefb1c0809" status: 200 len: 353 microversion: 2.1 time: 0.049700 Oct 03 14:59:13.061544 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 372/780] 10.222.0.46 () {58 vars in 1245 bytes} [Mon Oct 3 14:59:13 2022] GET /compute/v2.1/os-volumes/9f61c946-505a-4cc7-a60f-dbdefb1c0809 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:59:13.726926 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-995e1e83-d722-4d19-bcde-f927dbc0fad7 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:13.727653 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-995e1e83-d722-4d19-bcde-f927dbc0fad7 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:13.734880 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-995e1e83-d722-4d19-bcde-f927dbc0fad7 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:13.735364 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-995e1e83-d722-4d19-bcde-f927dbc0fad7 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:13.735795 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-995e1e83-d722-4d19-bcde-f927dbc0fad7 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:13.736491 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-995e1e83-d722-4d19-bcde-f927dbc0fad7 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:13.736950 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-995e1e83-d722-4d19-bcde-f927dbc0fad7 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:13.737410 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-995e1e83-d722-4d19-bcde-f927dbc0fad7 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:13.868093 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-995e1e83-d722-4d19-bcde-f927dbc0fad7 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:13.875684 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-995e1e83-d722-4d19-bcde-f927dbc0fad7 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1565 microversion: 2.1 time: 0.152747 Oct 03 14:59:13.876241 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 409/781] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:13 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:14.075782 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-f7d3720c-e375-4f6f-8964-7e7488fc872b tempest-VolumesGetTestJSON-161728281 tempest-VolumesGetTestJSON-161728281-project] Calling method '.version_select at 0x7fe0d3422a60>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:14.104562 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.wsgi [None req-f7d3720c-e375-4f6f-8964-7e7488fc872b tempest-VolumesGetTestJSON-161728281 tempest-VolumesGetTestJSON-161728281-project] HTTP exception thrown: Volume 9f61c946-505a-4cc7-a60f-dbdefb1c0809 could not be found. Oct 03 14:59:14.106508 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-f7d3720c-e375-4f6f-8964-7e7488fc872b tempest-VolumesGetTestJSON-161728281 tempest-VolumesGetTestJSON-161728281-project] Request method failure captured: Oct 03 14:59:14.106508 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: request: GET /compute/v2.1/os-volumes/9f61c946-505a-4cc7-a60f-dbdefb1c0809 HTTP/1.1 Oct 03 14:59:14.106508 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept: application/json Oct 03 14:59:14.106508 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept-Encoding: identity Oct 03 14:59:14.106508 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Connection: close Oct 03 14:59:14.106508 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Length: 0 Oct 03 14:59:14.106508 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Type: application/json Oct 03 14:59:14.106508 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Host: 10.222.0.46 Oct 03 14:59:14.106508 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Openstack-System-Scope: None Oct 03 14:59:14.106508 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: User-Agent: python-urllib3/1.26.12 Oct 03 14:59:14.106508 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Auth-Token: gAAAAABjOvi_QOQGrOagnraelyVifml-rg7RfehraqEOfF3_LxpupDSfRQnKIVQaDEb0q_YsKEXi3W8FqA5nQy0QBCeUwH5V0yf64KzoXDR6R9-SrRL92Y5p0ZMZ_OPCtPPt5wJzcAPVO2lQ0myZ9vdDGykXXc15pieDsqhyAAigC_Bz2R1F3Iw Oct 03 14:59:14.106508 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Id: None Oct 03 14:59:14.106508 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Name: None Oct 03 14:59:14.106508 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Identity-Status: Confirmed Oct 03 14:59:14.106508 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Is-Admin-Project: True Oct 03 14:59:14.106508 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Id: default Oct 03 14:59:14.106508 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Name: Default Oct 03 14:59:14.106508 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Id: f9db3d362e9e4784a83cc3cd6fb6ddd5 Oct 03 14:59:14.106508 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Name: tempest-VolumesGetTestJSON-161728281 Oct 03 14:59:14.106508 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Role: member,reader Oct 03 14:59:14.106508 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Roles: member,reader Oct 03 14:59:14.108113 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f9db3d362e9e4784a83cc3cd6fb6ddd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f9db3d362e9e4784a83cc3cd6fb6ddd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f9db3d362e9e4784a83cc3cd6fb6ddd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f9db3d362e9e4784a83cc3cd6fb6ddd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 14:59:14.108113 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant: tempest-VolumesGetTestJSON-161728281 Oct 03 14:59:14.108113 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Id: f9db3d362e9e4784a83cc3cd6fb6ddd5 Oct 03 14:59:14.108113 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Name: tempest-VolumesGetTestJSON-161728281 Oct 03 14:59:14.108113 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User: tempest-VolumesGetTestJSON-161728281-project Oct 03 14:59:14.108113 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Id: default Oct 03 14:59:14.108113 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Name: Default Oct 03 14:59:14.108113 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Id: 2571ccc832ba4908954da476d6b267fb Oct 03 14:59:14.108113 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Name: tempest-VolumesGetTestJSON-161728281-project Oct 03 14:59:14.108113 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: method: Oct 03 14:59:14.108113 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: exception: Volume 9f61c946-505a-4cc7-a60f-dbdefb1c0809 could not be found. Oct 03 14:59:14.108113 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: action_args: {'id': '9f61c946-505a-4cc7-a60f-dbdefb1c0809'} Oct 03 14:59:14.108113 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:59:14.109061 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:14.109061 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 14:59:14.109061 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 14:59:14.109061 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 14:59:14.109061 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 14:59:14.109061 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 14:59:14.109061 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 14:59:14.109061 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 14:59:14.109061 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 14:59:14.109061 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 14:59:14.109061 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 14:59:14.109061 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 14:59:14.109061 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 14:59:14.109061 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 14:59:14.109061 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 14:59:14.109061 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9f61c946-505a-4cc7-a60f-dbdefb1c0809 could not be found. (HTTP 404) (Request-ID: req-1677bd61-d72e-4f25-af13-7e116ceaeec5) Oct 03 14:59:14.109061 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:59:14.109061 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:14.109061 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:59:14.110694 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:14.110694 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 03 14:59:14.110694 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 03 14:59:14.110694 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 14:59:14.110694 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 14:59:14.110694 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 14:59:14.110694 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 14:59:14.110694 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 14:59:14.110694 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 14:59:14.110694 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 14:59:14.110694 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 14:59:14.110694 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 14:59:14.110694 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 14:59:14.110694 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 14:59:14.110694 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 14:59:14.110694 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 14:59:14.110694 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 14:59:14.110694 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 14:59:14.110694 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 14:59:14.112053 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 14:59:14.112053 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 14:59:14.112053 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 14:59:14.112053 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 14:59:14.112053 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9f61c946-505a-4cc7-a60f-dbdefb1c0809 could not be found. Oct 03 14:59:14.112053 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:59:14.112053 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:14.112053 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:59:14.112053 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:14.112053 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:59:14.112053 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:59:14.112053 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:59:14.112053 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:59:14.112053 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:59:14.112053 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:59:14.112053 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:59:14.112053 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:59:14.112053 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 03 14:59:14.112053 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:59:14.113462 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9f61c946-505a-4cc7-a60f-dbdefb1c0809 could not be found. Oct 03 14:59:14.113462 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:59:14.113462 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:14.113462 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:59:14.113462 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:14.113462 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:59:14.113462 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:59:14.113462 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:59:14.113462 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:59:14.113462 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9f61c946-505a-4cc7-a60f-dbdefb1c0809 could not be found. Oct 03 14:59:14.113462 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:59:14.113462 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-f7d3720c-e375-4f6f-8964-7e7488fc872b tempest-VolumesGetTestJSON-161728281 tempest-VolumesGetTestJSON-161728281-project] Returning 404 to user: Volume 9f61c946-505a-4cc7-a60f-dbdefb1c0809 could not be found. {{(pid=126852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:59:14.113462 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-f7d3720c-e375-4f6f-8964-7e7488fc872b tempest-VolumesGetTestJSON-161728281 tempest-VolumesGetTestJSON-161728281-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/9f61c946-505a-4cc7-a60f-dbdefb1c0809" status: 404 len: 109 microversion: 2.1 time: 0.036616 Oct 03 14:59:14.113462 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 373/782] 10.222.0.46 () {58 vars in 1245 bytes} [Mon Oct 3 14:59:14 2022] GET /compute/v2.1/os-volumes/9f61c946-505a-4cc7-a60f-dbdefb1c0809 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:59:14.898332 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-dd8fee0a-58ef-4ec2-a6a5-1ab031d4448c tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:14.899293 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-dd8fee0a-58ef-4ec2-a6a5-1ab031d4448c tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:14.905902 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dd8fee0a-58ef-4ec2-a6a5-1ab031d4448c tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:14.906327 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dd8fee0a-58ef-4ec2-a6a5-1ab031d4448c tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:14.906918 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dd8fee0a-58ef-4ec2-a6a5-1ab031d4448c tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:14.907728 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dd8fee0a-58ef-4ec2-a6a5-1ab031d4448c tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:14.908383 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dd8fee0a-58ef-4ec2-a6a5-1ab031d4448c tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:14.909031 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dd8fee0a-58ef-4ec2-a6a5-1ab031d4448c tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:15.062988 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-dd8fee0a-58ef-4ec2-a6a5-1ab031d4448c tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:15.070901 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-dd8fee0a-58ef-4ec2-a6a5-1ab031d4448c tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1566 microversion: 2.1 time: 0.176305 Oct 03 14:59:15.071482 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 410/783] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:14 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1566 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:15.095311 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-63f2ff77-46d8-450f-b448-31da3c8a0a13 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:59:15.095921 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-63f2ff77-46d8-450f-b448-31da3c8a0a13 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:15.102311 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-63f2ff77-46d8-450f-b448-31da3c8a0a13 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:15.102802 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-63f2ff77-46d8-450f-b448-31da3c8a0a13 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:15.103241 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-63f2ff77-46d8-450f-b448-31da3c8a0a13 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:15.103935 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-63f2ff77-46d8-450f-b448-31da3c8a0a13 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:15.104396 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-63f2ff77-46d8-450f-b448-31da3c8a0a13 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:15.105058 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-63f2ff77-46d8-450f-b448-31da3c8a0a13 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:15.147798 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-63f2ff77-46d8-450f-b448-31da3c8a0a13 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126852) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 03 14:59:15.213037 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-63f2ff77-46d8-450f-b448-31da3c8a0a13 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "POST /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e/action" status: 202 len: 0 microversion: 2.1 time: 0.122747 Oct 03 14:59:15.213925 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 374/784] 10.222.0.46 () {60 vars in 1278 bytes} [Mon Oct 3 14:59:15 2022] POST /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:59:15.223216 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-3efeefd3-be93-4390-8a9f-8d01e9819039 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:15.223909 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-3efeefd3-be93-4390-8a9f-8d01e9819039 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:15.231550 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3efeefd3-be93-4390-8a9f-8d01e9819039 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:15.232917 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3efeefd3-be93-4390-8a9f-8d01e9819039 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:15.233538 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3efeefd3-be93-4390-8a9f-8d01e9819039 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:15.234533 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3efeefd3-be93-4390-8a9f-8d01e9819039 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:15.235216 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3efeefd3-be93-4390-8a9f-8d01e9819039 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:15.235723 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3efeefd3-be93-4390-8a9f-8d01e9819039 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:15.461162 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-3efeefd3-be93-4390-8a9f-8d01e9819039 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:15.479998 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-3efeefd3-be93-4390-8a9f-8d01e9819039 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1574 microversion: 2.1 time: 0.261208 Oct 03 14:59:15.480580 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 411/785] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:15 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1574 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:59:16.505421 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-001835df-767b-478a-b2e3-6e595650158d tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:16.505894 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-001835df-767b-478a-b2e3-6e595650158d tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:16.511756 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-001835df-767b-478a-b2e3-6e595650158d tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:16.512240 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-001835df-767b-478a-b2e3-6e595650158d tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:16.512672 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-001835df-767b-478a-b2e3-6e595650158d tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:16.514027 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-001835df-767b-478a-b2e3-6e595650158d tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:16.514487 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-001835df-767b-478a-b2e3-6e595650158d tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:16.514910 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-001835df-767b-478a-b2e3-6e595650158d tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:16.649126 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-001835df-767b-478a-b2e3-6e595650158d tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:16.656788 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-001835df-767b-478a-b2e3-6e595650158d tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1516 microversion: 2.1 time: 0.155985 Oct 03 14:59:16.657355 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 375/786] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:16 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:17.680044 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-d9855349-033c-4296-8b82-b41a11148332 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:17.680677 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-d9855349-033c-4296-8b82-b41a11148332 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:17.687273 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d9855349-033c-4296-8b82-b41a11148332 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:17.687754 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d9855349-033c-4296-8b82-b41a11148332 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:17.688182 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d9855349-033c-4296-8b82-b41a11148332 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:17.688875 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d9855349-033c-4296-8b82-b41a11148332 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:17.689324 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d9855349-033c-4296-8b82-b41a11148332 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:17.689795 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d9855349-033c-4296-8b82-b41a11148332 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:17.821887 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-d9855349-033c-4296-8b82-b41a11148332 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:17.830014 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-d9855349-033c-4296-8b82-b41a11148332 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1572 microversion: 2.1 time: 0.153794 Oct 03 14:59:17.830578 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 412/787] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:17 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1572 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:18.108815 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-c5307766-3d9a-494d-a34e-f51b60429412 req-285b4c7f-5292-4129-b95c-4b01e3de7a94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe4e9466-74aa-4df2-8a80-8c79b26bc20e", "name": "network-vif-unplugged", "status": "completed", "tag": "e321d3a6-46f2-4be4-9d86-b86c2bf327ff"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:59:18.119213 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-c5307766-3d9a-494d-a34e-f51b60429412 req-285b4c7f-5292-4129-b95c-4b01e3de7a94 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:18.119704 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-c5307766-3d9a-494d-a34e-f51b60429412 req-285b4c7f-5292-4129-b95c-4b01e3de7a94 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:18.120145 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-c5307766-3d9a-494d-a34e-f51b60429412 req-285b4c7f-5292-4129-b95c-4b01e3de7a94 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:18.132117 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-c5307766-3d9a-494d-a34e-f51b60429412 req-285b4c7f-5292-4129-b95c-4b01e3de7a94 service nova] Creating event network-vif-unplugged:e321d3a6-46f2-4be4-9d86-b86c2bf327ff for instance fe4e9466-74aa-4df2-8a80-8c79b26bc20e on hv-cinder-85987 Oct 03 14:59:18.137338 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-c5307766-3d9a-494d-a34e-f51b60429412 req-285b4c7f-5292-4129-b95c-4b01e3de7a94 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032053 Oct 03 14:59:18.138944 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 376/788] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:59:18.856596 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-116056d6-ec3f-4fb0-bfd2-f24c4e0d0f0d tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:18.858120 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-116056d6-ec3f-4fb0-bfd2-f24c4e0d0f0d tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:18.864609 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-116056d6-ec3f-4fb0-bfd2-f24c4e0d0f0d tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:18.865101 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-116056d6-ec3f-4fb0-bfd2-f24c4e0d0f0d tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:18.865563 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-116056d6-ec3f-4fb0-bfd2-f24c4e0d0f0d tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:18.866265 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-116056d6-ec3f-4fb0-bfd2-f24c4e0d0f0d tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:18.866725 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-116056d6-ec3f-4fb0-bfd2-f24c4e0d0f0d tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:18.867155 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-116056d6-ec3f-4fb0-bfd2-f24c4e0d0f0d tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:19.018725 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-116056d6-ec3f-4fb0-bfd2-f24c4e0d0f0d tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:19.026355 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-116056d6-ec3f-4fb0-bfd2-f24c4e0d0f0d tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1572 microversion: 2.1 time: 0.175911 Oct 03 14:59:19.026924 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 413/789] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:18 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1572 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:20.052168 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-7e71fc0e-cd98-4ce2-8433-f6fa168156f0 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:20.052875 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-7e71fc0e-cd98-4ce2-8433-f6fa168156f0 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:20.054844 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=4 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:59:20.060155 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7e71fc0e-cd98-4ce2-8433-f6fa168156f0 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:20.060650 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7e71fc0e-cd98-4ce2-8433-f6fa168156f0 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:20.061741 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7e71fc0e-cd98-4ce2-8433-f6fa168156f0 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:20.062474 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7e71fc0e-cd98-4ce2-8433-f6fa168156f0 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:20.062946 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7e71fc0e-cd98-4ce2-8433-f6fa168156f0 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:20.063376 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7e71fc0e-cd98-4ce2-8433-f6fa168156f0 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:20.195998 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-7e71fc0e-cd98-4ce2-8433-f6fa168156f0 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:20.203708 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-7e71fc0e-cd98-4ce2-8433-f6fa168156f0 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1572 microversion: 2.1 time: 0.156337 Oct 03 14:59:20.204848 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 377/790] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:20 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1572 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:21.228275 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-988e4821-9dc8-4d96-97a6-0febb87cad9f tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:21.228890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-988e4821-9dc8-4d96-97a6-0febb87cad9f tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:21.235289 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-988e4821-9dc8-4d96-97a6-0febb87cad9f tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:21.235769 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-988e4821-9dc8-4d96-97a6-0febb87cad9f tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:21.236204 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-988e4821-9dc8-4d96-97a6-0febb87cad9f tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:21.236889 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-988e4821-9dc8-4d96-97a6-0febb87cad9f tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:21.237370 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-988e4821-9dc8-4d96-97a6-0febb87cad9f tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:21.237796 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-988e4821-9dc8-4d96-97a6-0febb87cad9f tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:21.371925 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-988e4821-9dc8-4d96-97a6-0febb87cad9f tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:21.380116 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-988e4821-9dc8-4d96-97a6-0febb87cad9f tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1572 microversion: 2.1 time: 0.155798 Oct 03 14:59:21.380679 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 414/791] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:21 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1572 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:22.404526 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-24e55c5a-1051-4686-8210-325e0c80a9d1 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:22.405122 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-24e55c5a-1051-4686-8210-325e0c80a9d1 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:22.411649 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-24e55c5a-1051-4686-8210-325e0c80a9d1 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:22.412133 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-24e55c5a-1051-4686-8210-325e0c80a9d1 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:22.412572 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-24e55c5a-1051-4686-8210-325e0c80a9d1 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:22.413257 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-24e55c5a-1051-4686-8210-325e0c80a9d1 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:22.413774 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-24e55c5a-1051-4686-8210-325e0c80a9d1 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:22.414197 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-24e55c5a-1051-4686-8210-325e0c80a9d1 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:22.542923 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-24e55c5a-1051-4686-8210-325e0c80a9d1 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:22.551163 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-24e55c5a-1051-4686-8210-325e0c80a9d1 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1572 microversion: 2.1 time: 0.150463 Oct 03 14:59:22.551669 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 378/792] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:22 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1572 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:23.574402 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-bc42a5fa-67a2-432f-a395-eb980061d988 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:23.575008 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-bc42a5fa-67a2-432f-a395-eb980061d988 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:23.581967 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bc42a5fa-67a2-432f-a395-eb980061d988 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:23.582443 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bc42a5fa-67a2-432f-a395-eb980061d988 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:23.582870 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bc42a5fa-67a2-432f-a395-eb980061d988 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:23.583802 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bc42a5fa-67a2-432f-a395-eb980061d988 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:23.584247 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bc42a5fa-67a2-432f-a395-eb980061d988 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:23.584662 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bc42a5fa-67a2-432f-a395-eb980061d988 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:23.711395 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-bc42a5fa-67a2-432f-a395-eb980061d988 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:23.718990 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-bc42a5fa-67a2-432f-a395-eb980061d988 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1572 microversion: 2.1 time: 0.148396 Oct 03 14:59:23.719544 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 415/793] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:23 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1572 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:24.743609 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-3e0c17a4-1f06-42eb-9312-9df2a7c61572 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:24.744137 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-3e0c17a4-1f06-42eb-9312-9df2a7c61572 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:24.750395 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3e0c17a4-1f06-42eb-9312-9df2a7c61572 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:24.750876 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3e0c17a4-1f06-42eb-9312-9df2a7c61572 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:24.751313 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3e0c17a4-1f06-42eb-9312-9df2a7c61572 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:24.751996 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3e0c17a4-1f06-42eb-9312-9df2a7c61572 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:24.752480 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3e0c17a4-1f06-42eb-9312-9df2a7c61572 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:24.752905 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3e0c17a4-1f06-42eb-9312-9df2a7c61572 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:24.880023 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-3e0c17a4-1f06-42eb-9312-9df2a7c61572 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:24.887663 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-3e0c17a4-1f06-42eb-9312-9df2a7c61572 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1572 microversion: 2.1 time: 0.148008 Oct 03 14:59:24.888226 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 379/794] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:24 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1572 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:25.915494 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-ff710388-4915-4ab4-9dc7-0cdcf8d03793 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:25.916219 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-ff710388-4915-4ab4-9dc7-0cdcf8d03793 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:25.923255 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ff710388-4915-4ab4-9dc7-0cdcf8d03793 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:25.923701 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ff710388-4915-4ab4-9dc7-0cdcf8d03793 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:25.924226 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ff710388-4915-4ab4-9dc7-0cdcf8d03793 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:25.924825 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ff710388-4915-4ab4-9dc7-0cdcf8d03793 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:25.925286 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ff710388-4915-4ab4-9dc7-0cdcf8d03793 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:25.925744 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ff710388-4915-4ab4-9dc7-0cdcf8d03793 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:26.057255 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-ff710388-4915-4ab4-9dc7-0cdcf8d03793 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:26.065162 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-ff710388-4915-4ab4-9dc7-0cdcf8d03793 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1572 microversion: 2.1 time: 0.153634 Oct 03 14:59:26.065764 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 416/795] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:25 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1572 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:27.092386 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-0791fe9b-c105-40e6-aad7-b6e9fe1e3695 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:27.093118 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-0791fe9b-c105-40e6-aad7-b6e9fe1e3695 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:27.100072 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0791fe9b-c105-40e6-aad7-b6e9fe1e3695 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:27.100557 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0791fe9b-c105-40e6-aad7-b6e9fe1e3695 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:27.100991 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0791fe9b-c105-40e6-aad7-b6e9fe1e3695 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:27.101728 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0791fe9b-c105-40e6-aad7-b6e9fe1e3695 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:27.102183 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0791fe9b-c105-40e6-aad7-b6e9fe1e3695 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:27.102628 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0791fe9b-c105-40e6-aad7-b6e9fe1e3695 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:27.234105 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-0791fe9b-c105-40e6-aad7-b6e9fe1e3695 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:27.241656 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-0791fe9b-c105-40e6-aad7-b6e9fe1e3695 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1572 microversion: 2.1 time: 0.157185 Oct 03 14:59:27.242218 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 380/796] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:27 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1572 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:28.266011 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-a49a96c5-1d26-4091-b010-3260afd4a7b6 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:28.266648 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-a49a96c5-1d26-4091-b010-3260afd4a7b6 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:28.273627 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a49a96c5-1d26-4091-b010-3260afd4a7b6 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:28.275189 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a49a96c5-1d26-4091-b010-3260afd4a7b6 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:28.280342 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a49a96c5-1d26-4091-b010-3260afd4a7b6 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:28.280342 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a49a96c5-1d26-4091-b010-3260afd4a7b6 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:28.280342 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a49a96c5-1d26-4091-b010-3260afd4a7b6 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:28.280342 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a49a96c5-1d26-4091-b010-3260afd4a7b6 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:28.398264 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-e034520a-bdb9-4061-a577-077de8a21d9b req-ffa45c06-9bb0-4fca-acfb-d71b0c4682da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe4e9466-74aa-4df2-8a80-8c79b26bc20e", "name": "network-vif-plugged", "status": "completed", "tag": "e321d3a6-46f2-4be4-9d86-b86c2bf327ff"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:59:28.410729 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-e034520a-bdb9-4061-a577-077de8a21d9b req-ffa45c06-9bb0-4fca-acfb-d71b0c4682da service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:28.411455 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-e034520a-bdb9-4061-a577-077de8a21d9b req-ffa45c06-9bb0-4fca-acfb-d71b0c4682da service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:28.411953 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-e034520a-bdb9-4061-a577-077de8a21d9b req-ffa45c06-9bb0-4fca-acfb-d71b0c4682da service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:28.425537 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-e034520a-bdb9-4061-a577-077de8a21d9b req-ffa45c06-9bb0-4fca-acfb-d71b0c4682da service nova] Creating event network-vif-plugged:e321d3a6-46f2-4be4-9d86-b86c2bf327ff for instance fe4e9466-74aa-4df2-8a80-8c79b26bc20e on hv-cinder-85987 Oct 03 14:59:28.430568 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-e034520a-bdb9-4061-a577-077de8a21d9b req-ffa45c06-9bb0-4fca-acfb-d71b0c4682da service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037079 Oct 03 14:59:28.432027 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-a49a96c5-1d26-4091-b010-3260afd4a7b6 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:28.432209 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 381/797] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:59:28.440600 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-a49a96c5-1d26-4091-b010-3260afd4a7b6 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1572 microversion: 2.1 time: 0.179335 Oct 03 14:59:28.441172 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 417/798] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:28 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1572 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:29.465560 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-c3a156bb-2aa8-461c-9281-242bed90926f tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:29.466264 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-c3a156bb-2aa8-461c-9281-242bed90926f tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:29.472940 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c3a156bb-2aa8-461c-9281-242bed90926f tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:29.473421 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c3a156bb-2aa8-461c-9281-242bed90926f tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:29.473888 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c3a156bb-2aa8-461c-9281-242bed90926f tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:29.474573 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c3a156bb-2aa8-461c-9281-242bed90926f tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:29.475031 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c3a156bb-2aa8-461c-9281-242bed90926f tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:29.475455 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c3a156bb-2aa8-461c-9281-242bed90926f tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:29.606025 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-c3a156bb-2aa8-461c-9281-242bed90926f tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:29.613849 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-c3a156bb-2aa8-461c-9281-242bed90926f tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1559 microversion: 2.1 time: 0.152869 Oct 03 14:59:29.614511 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 382/799] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:29 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:39.073638 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-a468bfdd-f4ea-40fa-b1d7-45aa49b34504 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:39.074255 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-a468bfdd-f4ea-40fa-b1d7-45aa49b34504 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 78499c1b-6aff-4bab-8bc4-495a949e3637] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:39.076795 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_api:SELECT=27 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:59:39.077686 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=81 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:59:39.084037 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a468bfdd-f4ea-40fa-b1d7-45aa49b34504 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:39.084523 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a468bfdd-f4ea-40fa-b1d7-45aa49b34504 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:39.084956 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a468bfdd-f4ea-40fa-b1d7-45aa49b34504 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:39.085789 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a468bfdd-f4ea-40fa-b1d7-45aa49b34504 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:39.086147 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a468bfdd-f4ea-40fa-b1d7-45aa49b34504 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:39.086566 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a468bfdd-f4ea-40fa-b1d7-45aa49b34504 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:39.111814 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-a468bfdd-f4ea-40fa-b1d7-45aa49b34504 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637/ips" status: 200 len: 149 microversion: 2.1 time: 0.042381 Oct 03 14:59:39.112364 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 418/800] 10.222.0.46 () {58 vars in 1248 bytes} [Mon Oct 3 14:59:39 2022] GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:59:39.793384 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-02263625-ecb0-4a9d-8d13-68a42fbebde7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:39.795593 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-02263625-ecb0-4a9d-8d13-68a42fbebde7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:39.799008 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_api:SELECT=11 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:59:39.799669 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:59:39.803632 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-02263625-ecb0-4a9d-8d13-68a42fbebde7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:39.804127 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-02263625-ecb0-4a9d-8d13-68a42fbebde7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:39.804559 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-02263625-ecb0-4a9d-8d13-68a42fbebde7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:39.805252 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-02263625-ecb0-4a9d-8d13-68a42fbebde7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:39.805735 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-02263625-ecb0-4a9d-8d13-68a42fbebde7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:39.806153 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-02263625-ecb0-4a9d-8d13-68a42fbebde7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:39.840793 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-02263625-ecb0-4a9d-8d13-68a42fbebde7 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051265 Oct 03 14:59:39.841348 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 383/801] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 3 14:59:39 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:59:39.905049 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-bb759457-cbdd-40b4-8f1a-f96606e0bc62 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:39.905562 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-bb759457-cbdd-40b4-8f1a-f96606e0bc62 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:39.912223 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bb759457-cbdd-40b4-8f1a-f96606e0bc62 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:39.912700 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bb759457-cbdd-40b4-8f1a-f96606e0bc62 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:39.913126 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bb759457-cbdd-40b4-8f1a-f96606e0bc62 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:39.913833 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bb759457-cbdd-40b4-8f1a-f96606e0bc62 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:39.914289 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bb759457-cbdd-40b4-8f1a-f96606e0bc62 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:39.914708 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bb759457-cbdd-40b4-8f1a-f96606e0bc62 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:39.939812 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-bb759457-cbdd-40b4-8f1a-f96606e0bc62 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Going to try to terminate instance {{(pid=126851) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:59:40.020740 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-bb759457-cbdd-40b4-8f1a-f96606e0bc62 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "DELETE /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 204 len: 0 microversion: 2.1 time: 0.118973 Oct 03 14:59:40.021516 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 419/802] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 3 14:59:39 2022] DELETE /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:59:40.030026 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-0966cc81-2e74-4876-8c1f-9a52c774f737 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:40.030684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-0966cc81-2e74-4876-8c1f-9a52c774f737 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:40.038612 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0966cc81-2e74-4876-8c1f-9a52c774f737 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:40.039105 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0966cc81-2e74-4876-8c1f-9a52c774f737 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:40.039541 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0966cc81-2e74-4876-8c1f-9a52c774f737 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:40.040274 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0966cc81-2e74-4876-8c1f-9a52c774f737 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:40.040761 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0966cc81-2e74-4876-8c1f-9a52c774f737 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:40.041195 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0966cc81-2e74-4876-8c1f-9a52c774f737 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:40.174985 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-0966cc81-2e74-4876-8c1f-9a52c774f737 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:40.182761 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-0966cc81-2e74-4876-8c1f-9a52c774f737 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1669 microversion: 2.1 time: 0.156652 Oct 03 14:59:40.183503 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 384/803] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:40 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:40.478981 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-62429c54-cbe1-4e33-affd-deff336d8dc4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9483dca3-5b1d-4838-af6a-a683c95481e7"}} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:59:40.481471 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-62429c54-cbe1-4e33-affd-deff336d8dc4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 78499c1b-6aff-4bab-8bc4-495a949e3637] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:40.487302 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-62429c54-cbe1-4e33-affd-deff336d8dc4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:40.487788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-62429c54-cbe1-4e33-affd-deff336d8dc4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:40.488229 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-62429c54-cbe1-4e33-affd-deff336d8dc4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:40.488921 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-62429c54-cbe1-4e33-affd-deff336d8dc4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:40.489385 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-62429c54-cbe1-4e33-affd-deff336d8dc4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:40.489835 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-62429c54-cbe1-4e33-affd-deff336d8dc4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:41.100524 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-62429c54-cbe1-4e33-affd-deff336d8dc4 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "POST /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.625295 Oct 03 14:59:41.106565 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 420/804] 10.222.0.46 () {60 vars in 1323 bytes} [Mon Oct 3 14:59:40 2022] POST /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637/os-volume_attachments => generated 194 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:59:41.206334 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-745d6188-c88b-41ae-a417-33f73e781098 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:41.207570 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-745d6188-c88b-41ae-a417-33f73e781098 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:41.215020 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-745d6188-c88b-41ae-a417-33f73e781098 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:41.215331 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-745d6188-c88b-41ae-a417-33f73e781098 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:41.215942 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-745d6188-c88b-41ae-a417-33f73e781098 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:41.216819 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-745d6188-c88b-41ae-a417-33f73e781098 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:41.217545 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-745d6188-c88b-41ae-a417-33f73e781098 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:41.218065 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-745d6188-c88b-41ae-a417-33f73e781098 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:41.404852 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-745d6188-c88b-41ae-a417-33f73e781098 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:41.416063 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-745d6188-c88b-41ae-a417-33f73e781098 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1669 microversion: 2.1 time: 0.213515 Oct 03 14:59:41.416782 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 385/805] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:41 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1669 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:42.441866 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-5394f522-4c14-4d79-82a4-b608835ff0ab tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:42.443204 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-5394f522-4c14-4d79-82a4-b608835ff0ab tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:42.449802 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5394f522-4c14-4d79-82a4-b608835ff0ab tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:42.450408 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5394f522-4c14-4d79-82a4-b608835ff0ab tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:42.450987 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5394f522-4c14-4d79-82a4-b608835ff0ab tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:42.451693 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5394f522-4c14-4d79-82a4-b608835ff0ab tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:42.452348 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5394f522-4c14-4d79-82a4-b608835ff0ab tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:42.453524 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5394f522-4c14-4d79-82a4-b608835ff0ab tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:42.521269 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-5394f522-4c14-4d79-82a4-b608835ff0ab tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:42.531357 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-5394f522-4c14-4d79-82a4-b608835ff0ab tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 200 len: 1602 microversion: 2.1 time: 0.094432 Oct 03 14:59:42.532064 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 421/806] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:42 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 1602 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:42.617232 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-939f5d99-2350-44a8-a589-4bf13d0d34fc req-5c5b71d4-39ef-4ac3-b0f4-c42075a4f151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bac89fd1-5f09-42a7-90f2-5074c12859fc", "name": "network-vif-deleted", "tag": "8e144fc1-dc68-4200-84eb-87fed3d70fcb"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:59:42.628938 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-939f5d99-2350-44a8-a589-4bf13d0d34fc req-5c5b71d4-39ef-4ac3-b0f4-c42075a4f151 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:42.629427 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-939f5d99-2350-44a8-a589-4bf13d0d34fc req-5c5b71d4-39ef-4ac3-b0f4-c42075a4f151 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:42.630069 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-939f5d99-2350-44a8-a589-4bf13d0d34fc req-5c5b71d4-39ef-4ac3-b0f4-c42075a4f151 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:42.643715 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-939f5d99-2350-44a8-a589-4bf13d0d34fc req-5c5b71d4-39ef-4ac3-b0f4-c42075a4f151 service nova] Creating event network-vif-deleted:8e144fc1-dc68-4200-84eb-87fed3d70fcb for instance bac89fd1-5f09-42a7-90f2-5074c12859fc on hv-cinder-85987 Oct 03 14:59:42.649179 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-939f5d99-2350-44a8-a589-4bf13d0d34fc req-5c5b71d4-39ef-4ac3-b0f4-c42075a4f151 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035449 Oct 03 14:59:42.650660 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 386/807] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:59:43.554357 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-af19c457-f767-4d54-9de9-08933a1cd14b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:43.554969 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-af19c457-f767-4d54-9de9-08933a1cd14b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:43.561324 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-af19c457-f767-4d54-9de9-08933a1cd14b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:43.561845 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-af19c457-f767-4d54-9de9-08933a1cd14b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:43.562319 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-af19c457-f767-4d54-9de9-08933a1cd14b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:43.563007 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-af19c457-f767-4d54-9de9-08933a1cd14b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:43.563463 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-af19c457-f767-4d54-9de9-08933a1cd14b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:43.563888 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-af19c457-f767-4d54-9de9-08933a1cd14b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:43.577018 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.wsgi [None req-af19c457-f767-4d54-9de9-08933a1cd14b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] HTTP exception thrown: Instance bac89fd1-5f09-42a7-90f2-5074c12859fc could not be found. Oct 03 14:59:43.579232 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-af19c457-f767-4d54-9de9-08933a1cd14b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Request method failure captured: Oct 03 14:59:43.579232 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: request: GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc HTTP/1.1 Oct 03 14:59:43.579232 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept: application/json Oct 03 14:59:43.579232 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept-Encoding: identity Oct 03 14:59:43.579232 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Connection: close Oct 03 14:59:43.579232 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Length: 0 Oct 03 14:59:43.579232 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Type: application/json Oct 03 14:59:43.579232 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Host: 10.222.0.46 Oct 03 14:59:43.579232 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Openstack-System-Scope: None Oct 03 14:59:43.579232 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: User-Agent: python-urllib3/1.26.12 Oct 03 14:59:43.579232 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Auth-Token: gAAAAABjOvcaBeyMTa88-0edz76OnaFj6uQQkiDsj4RLm8DiMF0Iy4KLXwqGA78nWIpmhaQ734BRxk6Um4V3DJ-EQp08k-8tzCH5HGef2o3hED3l5byC0hOi3LBM8pwAaKJMM5KxgspcKqQWsBzVq0V47S8aeDU3HrFE8sKEsc7_PFQWOAR-xfg Oct 03 14:59:43.579232 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Id: None Oct 03 14:59:43.579232 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Name: None Oct 03 14:59:43.579232 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Identity-Status: Confirmed Oct 03 14:59:43.579232 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Is-Admin-Project: True Oct 03 14:59:43.579232 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Id: default Oct 03 14:59:43.579232 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Name: Default Oct 03 14:59:43.579232 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Id: 8cf070b7d6ff419392acaddbbee1e242 Oct 03 14:59:43.579232 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Name: tempest-AttachVolumeTestJSON-1551759992 Oct 03 14:59:43.579232 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Role: member,reader Oct 03 14:59:43.579232 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Roles: member,reader Oct 03 14:59:43.580822 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8cf070b7d6ff419392acaddbbee1e242"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8cf070b7d6ff419392acaddbbee1e242"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8cf070b7d6ff419392acaddbbee1e242"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8cf070b7d6ff419392acaddbbee1e242"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 14:59:43.580822 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant: tempest-AttachVolumeTestJSON-1551759992 Oct 03 14:59:43.580822 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Id: 8cf070b7d6ff419392acaddbbee1e242 Oct 03 14:59:43.580822 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1551759992 Oct 03 14:59:43.580822 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User: tempest-AttachVolumeTestJSON-1551759992-project Oct 03 14:59:43.580822 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Id: default Oct 03 14:59:43.580822 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Name: Default Oct 03 14:59:43.580822 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Id: 0be78e1abb3947a2ac5881b9fd2f6fae Oct 03 14:59:43.580822 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Name: tempest-AttachVolumeTestJSON-1551759992-project Oct 03 14:59:43.580822 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: method: > Oct 03 14:59:43.580822 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: exception: Instance bac89fd1-5f09-42a7-90f2-5074c12859fc could not be found. Oct 03 14:59:43.580822 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: action_args: {'id': 'bac89fd1-5f09-42a7-90f2-5074c12859fc'} Oct 03 14:59:43.581824 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:59:43.581824 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:43.581824 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:59:43.581824 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:59:43.581824 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:59:43.581824 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:59:43.581824 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:59:43.581824 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:59:43.581824 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:59:43.581824 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:59:43.581824 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bac89fd1-5f09-42a7-90f2-5074c12859fc could not be found. Oct 03 14:59:43.581824 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:59:43.581824 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:43.581824 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:59:43.581824 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:43.581824 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:59:43.581824 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:59:43.581824 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:59:43.581824 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:59:43.581824 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:59:43.583311 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:59:43.583311 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:59:43.583311 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:59:43.583311 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:59:43.583311 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:59:43.583311 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:59:43.583311 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:59:43.583311 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bac89fd1-5f09-42a7-90f2-5074c12859fc could not be found. Oct 03 14:59:43.583311 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:59:43.583311 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:43.583311 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:59:43.583311 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:43.583311 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:59:43.583311 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:59:43.583311 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:59:43.583311 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:59:43.583311 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bac89fd1-5f09-42a7-90f2-5074c12859fc could not be found. Oct 03 14:59:43.583311 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 14:59:43.584392 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-af19c457-f767-4d54-9de9-08933a1cd14b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Returning 404 to user: Instance bac89fd1-5f09-42a7-90f2-5074c12859fc could not be found. {{(pid=126851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:59:43.584392 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-af19c457-f767-4d54-9de9-08933a1cd14b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 404 len: 111 microversion: 2.1 time: 0.030105 Oct 03 14:59:43.584392 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 422/808] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:43 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:59:43.590544 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-07d5802a-016d-4650-9599-a43393dc52a9 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '.version_select at 0x7fe0d33774c0>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:43.609362 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-07d5802a-016d-4650-9599-a43393dc52a9 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2055196" status: 202 len: 0 microversion: 2.1 time: 0.022841 Oct 03 14:59:43.609963 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 387/809] 10.222.0.46 () {58 vars in 1212 bytes} [Mon Oct 3 14:59:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2055196 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 14:59:44.234408 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-8fd6b06a-f494-448a-b9fb-f5a748e06435 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Action: 'create', calling method: .version_select at 0x7fe0d6cb0820>, body: {"keypair": {"name": "tempest-keypair-307646498", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZYc4NKbo+f8sgWeb4aBl7vXavBeL23p13sJZxVQgDhNFjv/AKACaWuT3bRq5eb2+1Q0DlwsF6GAu4orE9hD3FDD4neSmgyp1sW7wQajiHW1QE/iEHamkllB7Sa5Q0HQQ=="}} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:59:44.250918 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.quota [None req-8fd6b06a-f494-448a-b9fb-f5a748e06435 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Getting quotas for project 8cf070b7d6ff419392acaddbbee1e242. Resources: {'key_pairs'} {{(pid=126851) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:59:44.255014 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.quota [None req-8fd6b06a-f494-448a-b9fb-f5a748e06435 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Getting quotas for user 0be78e1abb3947a2ac5881b9fd2f6fae and project 8cf070b7d6ff419392acaddbbee1e242. Resources: {'key_pairs'} {{(pid=126851) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:59:44.277159 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-8fd6b06a-f494-448a-b9fb-f5a748e06435 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046584 Oct 03 14:59:44.277966 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 423/810] 10.222.0.46 () {60 vars in 1159 bytes} [Mon Oct 3 14:59:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:59:45.827129 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-12f2b104-78ce-4c7e-99e8-25ca0414c773 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1613506579", "imageRef": "add7a872-2ca1-4366-9a93-f0663fdb297b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3de19230-35e5-430c-b606-8b501507ea36"}], "security_groups": [{"name": "tempest-securitygroup--836015790"}], "key_name": "tempest-keypair-307646498", "user_data": "}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:59:45.934050 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.network.neutron [None req-12f2b104-78ce-4c7e-99e8-25ca0414c773 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] validate_networks() for [('3de19230-35e5-430c-b606-8b501507ea36', None, None, None, None, None)] {{(pid=126852) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:59:46.321801 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-12f2b104-78ce-4c7e-99e8-25ca0414c773 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Flavor limits 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:59:46.322229 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-12f2b104-78ce-4c7e-99e8-25ca0414c773 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Image limits 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:59:46.322706 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-12f2b104-78ce-4c7e-99e8-25ca0414c773 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Flavor pref 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:59:46.323120 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-12f2b104-78ce-4c7e-99e8-25ca0414c773 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Image pref 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:59:46.323533 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-12f2b104-78ce-4c7e-99e8-25ca0414c773 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:59:46.332191 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-12f2b104-78ce-4c7e-99e8-25ca0414c773 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:46.332933 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-12f2b104-78ce-4c7e-99e8-25ca0414c773 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:46.333370 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-12f2b104-78ce-4c7e-99e8-25ca0414c773 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:46.334135 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-12f2b104-78ce-4c7e-99e8-25ca0414c773 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:46.334596 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-12f2b104-78ce-4c7e-99e8-25ca0414c773 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:46.335023 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-12f2b104-78ce-4c7e-99e8-25ca0414c773 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:46.351701 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-12f2b104-78ce-4c7e-99e8-25ca0414c773 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Getting quotas for project 8cf070b7d6ff419392acaddbbee1e242. Resources: {'ram', 'instances', 'cores'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:59:46.355552 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-12f2b104-78ce-4c7e-99e8-25ca0414c773 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Getting quotas for user 0be78e1abb3947a2ac5881b9fd2f6fae and project 8cf070b7d6ff419392acaddbbee1e242. Resources: {'ram', 'instances', 'cores'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:59:46.366788 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-12f2b104-78ce-4c7e-99e8-25ca0414c773 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Going to run 1 instances... {{(pid=126852) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:59:46.369118 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-12f2b104-78ce-4c7e-99e8-25ca0414c773 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='add7a872-2ca1-4366-9a93-f0663fdb297b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:59:46.415718 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-12f2b104-78ce-4c7e-99e8-25ca0414c773 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.594050 Oct 03 14:59:46.416363 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 388/811] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 3 14:59:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 14:59:46.428442 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-35b5f01f-3524-4020-8221-08089e4fd628 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:46.429062 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-35b5f01f-3524-4020-8221-08089e4fd628 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:46.485996 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-35b5f01f-3524-4020-8221-08089e4fd628 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:46.493699 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-35b5f01f-3524-4020-8221-08089e4fd628 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb" status: 200 len: 1237 microversion: 2.1 time: 0.069250 Oct 03 14:59:46.505818 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 424/812] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:46 2022] GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb => generated 1237 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:47.516383 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-cd1bc54d-ef9f-4a34-89e5-db3847074420 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:47.517002 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-cd1bc54d-ef9f-4a34-89e5-db3847074420 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:47.523761 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cd1bc54d-ef9f-4a34-89e5-db3847074420 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:47.524256 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cd1bc54d-ef9f-4a34-89e5-db3847074420 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:47.524691 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cd1bc54d-ef9f-4a34-89e5-db3847074420 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:47.525399 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cd1bc54d-ef9f-4a34-89e5-db3847074420 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:47.525901 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cd1bc54d-ef9f-4a34-89e5-db3847074420 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:47.526330 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cd1bc54d-ef9f-4a34-89e5-db3847074420 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:47.588523 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-cd1bc54d-ef9f-4a34-89e5-db3847074420 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:47.596193 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-cd1bc54d-ef9f-4a34-89e5-db3847074420 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb" status: 200 len: 1289 microversion: 2.1 time: 0.084085 Oct 03 14:59:47.596756 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 389/813] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:47 2022] GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb => generated 1289 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:48.621092 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-5a56743a-af7d-4d93-9401-fad244b590cb tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:48.622979 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-5a56743a-af7d-4d93-9401-fad244b590cb tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:48.630034 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5a56743a-af7d-4d93-9401-fad244b590cb tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:48.630608 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5a56743a-af7d-4d93-9401-fad244b590cb tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:48.630966 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5a56743a-af7d-4d93-9401-fad244b590cb tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:48.631786 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5a56743a-af7d-4d93-9401-fad244b590cb tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:48.632643 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5a56743a-af7d-4d93-9401-fad244b590cb tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:48.634013 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5a56743a-af7d-4d93-9401-fad244b590cb tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:48.712288 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-5a56743a-af7d-4d93-9401-fad244b590cb tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:48.722112 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-5a56743a-af7d-4d93-9401-fad244b590cb tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb" status: 200 len: 1289 microversion: 2.1 time: 0.106049 Oct 03 14:59:48.722337 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-aafe7715-8dbf-4aa6-b13d-b26e714a6b48 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9483dca3-5b1d-4838-af6a-a683c95481e7"}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:59:48.723302 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 425/814] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:48 2022] GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb => generated 1289 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:48.727121 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-aafe7715-8dbf-4aa6-b13d-b26e714a6b48 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 78499c1b-6aff-4bab-8bc4-495a949e3637] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:48.736491 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-aafe7715-8dbf-4aa6-b13d-b26e714a6b48 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:48.736832 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-aafe7715-8dbf-4aa6-b13d-b26e714a6b48 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:48.737368 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-aafe7715-8dbf-4aa6-b13d-b26e714a6b48 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:48.738243 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-aafe7715-8dbf-4aa6-b13d-b26e714a6b48 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:48.738910 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-aafe7715-8dbf-4aa6-b13d-b26e714a6b48 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:48.739525 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-aafe7715-8dbf-4aa6-b13d-b26e714a6b48 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:48.837736 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.wsgi [None req-aafe7715-8dbf-4aa6-b13d-b26e714a6b48 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] HTTP exception thrown: Invalid volume: volume 9483dca3-5b1d-4838-af6a-a683c95481e7 is already attached to instances: 78499c1b-6aff-4bab-8bc4-495a949e3637 Oct 03 14:59:48.839684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-aafe7715-8dbf-4aa6-b13d-b26e714a6b48 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Request method failure captured: Oct 03 14:59:48.839684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: request: POST /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637/os-volume_attachments HTTP/1.1 Oct 03 14:59:48.839684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept: application/json Oct 03 14:59:48.839684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept-Encoding: identity Oct 03 14:59:48.839684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Connection: close Oct 03 14:59:48.839684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Length: 74 Oct 03 14:59:48.839684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Type: application/json Oct 03 14:59:48.839684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Host: 10.222.0.46 Oct 03 14:59:48.839684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Openstack-System-Scope: None Oct 03 14:59:48.839684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: User-Agent: python-urllib3/1.26.12 Oct 03 14:59:48.839684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Auth-Token: gAAAAABjOvcPpmkNazTZsKwP_dytsSc1mWeaFG9s70fvVPaYpq_ArFEvYfc7mC1blzmQmSzzs7KJ6XurvcTxRDIyBJ5kvUsRB0YKc-UpccrxHapwKNSjylJR67P3ZaQN5jh2ABzG340CmXB66R8211hYQUHG14HaVU9UDOYI7_9tJ27nTjX-zUs Oct 03 14:59:48.839684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Id: None Oct 03 14:59:48.839684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Name: None Oct 03 14:59:48.839684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Identity-Status: Confirmed Oct 03 14:59:48.839684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Is-Admin-Project: True Oct 03 14:59:48.839684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Id: default Oct 03 14:59:48.839684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Name: Default Oct 03 14:59:48.839684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Id: f441c0592cd146d3be851ac96cbc49dc Oct 03 14:59:48.839684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Name: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 14:59:48.839684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Role: member,reader Oct 03 14:59:48.839684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Roles: member,reader Oct 03 14:59:48.841225 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 14:59:48.841225 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 14:59:48.841225 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Id: f441c0592cd146d3be851ac96cbc49dc Oct 03 14:59:48.841225 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 14:59:48.841225 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User: tempest-AttachVolumeNegativeTest-1566300421-project Oct 03 14:59:48.841225 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Id: default Oct 03 14:59:48.841225 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Name: Default Oct 03 14:59:48.841225 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Id: 89c747f18b434e469ae61755e9f639ca Oct 03 14:59:48.841225 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Name: tempest-AttachVolumeNegativeTest-1566300421-project Oct 03 14:59:48.841225 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Oct 03 14:59:48.841225 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: {"volumeAttachment": {"volumeId": "9483dca3-5b1d-4838-af6a-a683c95481e7"}} Oct 03 14:59:48.841225 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: method: > Oct 03 14:59:48.842149 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: exception: Invalid volume: volume 9483dca3-5b1d-4838-af6a-a683c95481e7 is already attached to instances: 78499c1b-6aff-4bab-8bc4-495a949e3637 Oct 03 14:59:48.842149 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: action_args: {'server_id': '78499c1b-6aff-4bab-8bc4-495a949e3637', 'body': {'volumeAttachment': {'volumeId': '9483dca3-5b1d-4838-af6a-a683c95481e7'}}} Oct 03 14:59:48.842149 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:59:48.842149 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:48.842149 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 03 14:59:48.842149 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 03 14:59:48.842149 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 14:59:48.842149 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 14:59:48.842149 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 03 14:59:48.842149 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 14:59:48.842149 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 03 14:59:48.842149 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 03 14:59:48.842149 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 03 14:59:48.842149 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 03 14:59:48.842149 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9483dca3-5b1d-4838-af6a-a683c95481e7 is already attached to instances: 78499c1b-6aff-4bab-8bc4-495a949e3637 Oct 03 14:59:48.842149 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:59:48.842149 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:48.842149 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:59:48.842149 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:48.843678 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:59:48.843678 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:59:48.843678 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:59:48.843678 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:59:48.843678 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:59:48.843678 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:59:48.843678 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:59:48.843678 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:59:48.843678 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:59:48.843678 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:59:48.843678 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:59:48.843678 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:59:48.843678 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 03 14:59:48.843678 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 03 14:59:48.843678 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9483dca3-5b1d-4838-af6a-a683c95481e7 is already attached to instances: 78499c1b-6aff-4bab-8bc4-495a949e3637 Oct 03 14:59:48.843678 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:59:48.843678 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:48.843678 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:59:48.843678 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:48.843678 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:59:48.846387 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:59:48.846387 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:59:48.846387 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:59:48.846387 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9483dca3-5b1d-4838-af6a-a683c95481e7 is already attached to instances: 78499c1b-6aff-4bab-8bc4-495a949e3637 Oct 03 14:59:48.846387 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:59:48.847003 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-aafe7715-8dbf-4aa6-b13d-b26e714a6b48 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Returning 400 to user: Invalid volume: volume 9483dca3-5b1d-4838-af6a-a683c95481e7 is already attached to instances: 78499c1b-6aff-4bab-8bc4-495a949e3637 {{(pid=126852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:59:48.848148 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-aafe7715-8dbf-4aa6-b13d-b26e714a6b48 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "POST /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.132683 Oct 03 14:59:48.852177 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 390/815] 10.222.0.46 () {60 vars in 1323 bytes} [Mon Oct 3 14:59:48 2022] POST /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637/os-volume_attachments => generated 174 bytes in 134 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:59:48.940454 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-382e8703-e3e1-43e8-909e-23571b4f1917 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:48.941397 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-382e8703-e3e1-43e8-909e-23571b4f1917 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 78499c1b-6aff-4bab-8bc4-495a949e3637] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:48.947857 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-382e8703-e3e1-43e8-909e-23571b4f1917 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:48.948619 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-382e8703-e3e1-43e8-909e-23571b4f1917 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:48.949589 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-382e8703-e3e1-43e8-909e-23571b4f1917 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:48.951262 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-382e8703-e3e1-43e8-909e-23571b4f1917 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:48.951927 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-382e8703-e3e1-43e8-909e-23571b4f1917 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:48.952503 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-382e8703-e3e1-43e8-909e-23571b4f1917 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:49.058570 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.objects.instance [None req-382e8703-e3e1-43e8-909e-23571b4f1917 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lazy-loading 'services' on Instance uuid 78499c1b-6aff-4bab-8bc4-495a949e3637 {{(pid=126851) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:59:49.139971 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-382e8703-e3e1-43e8-909e-23571b4f1917 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "DELETE /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637/os-volume_attachments/9483dca3-5b1d-4838-af6a-a683c95481e7" status: 202 len: 0 microversion: 2.1 time: 0.203701 Oct 03 14:59:49.140981 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 426/816] 10.222.0.46 () {58 vars in 1416 bytes} [Mon Oct 3 14:59:48 2022] DELETE /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637/os-volume_attachments/9483dca3-5b1d-4838-af6a-a683c95481e7 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:59:49.149528 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-f0df0f6e-b2d6-4681-b931-d3b52d0d1ede tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:49.152206 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-f0df0f6e-b2d6-4681-b931-d3b52d0d1ede tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 78499c1b-6aff-4bab-8bc4-495a949e3637] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:49.160208 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f0df0f6e-b2d6-4681-b931-d3b52d0d1ede tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:49.160830 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f0df0f6e-b2d6-4681-b931-d3b52d0d1ede tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:49.161328 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f0df0f6e-b2d6-4681-b931-d3b52d0d1ede tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:49.162104 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f0df0f6e-b2d6-4681-b931-d3b52d0d1ede tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:49.162557 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f0df0f6e-b2d6-4681-b931-d3b52d0d1ede tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:49.162989 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f0df0f6e-b2d6-4681-b931-d3b52d0d1ede tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:49.202380 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-f0df0f6e-b2d6-4681-b931-d3b52d0d1ede tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056864 Oct 03 14:59:49.202939 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 391/817] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 3 14:59:49 2022] GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:59:49.750264 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-ddf8b4de-820f-4c3a-9b67-433153fffc1f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:49.750954 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-ddf8b4de-820f-4c3a-9b67-433153fffc1f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:49.757479 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ddf8b4de-820f-4c3a-9b67-433153fffc1f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:49.757997 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ddf8b4de-820f-4c3a-9b67-433153fffc1f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:49.758426 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ddf8b4de-820f-4c3a-9b67-433153fffc1f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:49.759108 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ddf8b4de-820f-4c3a-9b67-433153fffc1f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:49.759555 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ddf8b4de-820f-4c3a-9b67-433153fffc1f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:49.759973 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ddf8b4de-820f-4c3a-9b67-433153fffc1f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:49.824052 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-ddf8b4de-820f-4c3a-9b67-433153fffc1f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:49.834430 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-ddf8b4de-820f-4c3a-9b67-433153fffc1f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb" status: 200 len: 1295 microversion: 2.1 time: 0.088226 Oct 03 14:59:49.835201 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 427/818] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:49 2022] GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb => generated 1295 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:50.216098 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-13d54563-bbf7-43ba-8722-e9a6e5219e2e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:50.219697 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-13d54563-bbf7-43ba-8722-e9a6e5219e2e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 78499c1b-6aff-4bab-8bc4-495a949e3637] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:50.229162 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-13d54563-bbf7-43ba-8722-e9a6e5219e2e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:50.229879 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-13d54563-bbf7-43ba-8722-e9a6e5219e2e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:50.230953 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-13d54563-bbf7-43ba-8722-e9a6e5219e2e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:50.231439 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-13d54563-bbf7-43ba-8722-e9a6e5219e2e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:50.232493 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-13d54563-bbf7-43ba-8722-e9a6e5219e2e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:50.233051 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-13d54563-bbf7-43ba-8722-e9a6e5219e2e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:50.269167 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-13d54563-bbf7-43ba-8722-e9a6e5219e2e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057426 Oct 03 14:59:50.269760 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 392/819] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 3 14:59:50 2022] GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:59:50.857479 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-cf2433e4-46a3-4efe-a329-432d4bd7d127 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:50.858102 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-cf2433e4-46a3-4efe-a329-432d4bd7d127 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:50.864957 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cf2433e4-46a3-4efe-a329-432d4bd7d127 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:50.865441 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cf2433e4-46a3-4efe-a329-432d4bd7d127 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:50.865905 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cf2433e4-46a3-4efe-a329-432d4bd7d127 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:50.866602 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cf2433e4-46a3-4efe-a329-432d4bd7d127 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:50.867036 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cf2433e4-46a3-4efe-a329-432d4bd7d127 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:50.867457 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cf2433e4-46a3-4efe-a329-432d4bd7d127 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:50.956040 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-a9938879-3625-4091-9b63-f4f4a3cbaec3 req-c818202e-6ba1-4b76-8267-5088c01b2a30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cf56714-ab05-4dc1-ae52-0100ec2d6aeb", "tag": "94d80152-f32d-4385-b2c7-39409ac0316c"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:59:50.977524 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-a9938879-3625-4091-9b63-f4f4a3cbaec3 req-c818202e-6ba1-4b76-8267-5088c01b2a30 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:50.978276 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-a9938879-3625-4091-9b63-f4f4a3cbaec3 req-c818202e-6ba1-4b76-8267-5088c01b2a30 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:50.978719 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-a9938879-3625-4091-9b63-f4f4a3cbaec3 req-c818202e-6ba1-4b76-8267-5088c01b2a30 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:50.990616 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-a9938879-3625-4091-9b63-f4f4a3cbaec3 req-c818202e-6ba1-4b76-8267-5088c01b2a30 service nova] Creating event network-changed:94d80152-f32d-4385-b2c7-39409ac0316c for instance 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb on hv-cinder-85987 Oct 03 14:59:50.995489 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-a9938879-3625-4091-9b63-f4f4a3cbaec3 req-c818202e-6ba1-4b76-8267-5088c01b2a30 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043202 Oct 03 14:59:50.996471 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 393/820] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:59:51.000295 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-cf2433e4-46a3-4efe-a329-432d4bd7d127 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:51.007890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-cf2433e4-46a3-4efe-a329-432d4bd7d127 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb" status: 200 len: 1362 microversion: 2.1 time: 0.154237 Oct 03 14:59:51.021139 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 428/821] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:50 2022] GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:51.283314 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-07285300-79b4-4119-afe8-29623e666e77 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:51.286204 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-07285300-79b4-4119-afe8-29623e666e77 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 78499c1b-6aff-4bab-8bc4-495a949e3637] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:51.292436 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-07285300-79b4-4119-afe8-29623e666e77 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:51.292924 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-07285300-79b4-4119-afe8-29623e666e77 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:51.293358 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-07285300-79b4-4119-afe8-29623e666e77 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:51.294251 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-07285300-79b4-4119-afe8-29623e666e77 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:51.294707 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-07285300-79b4-4119-afe8-29623e666e77 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:51.295158 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-07285300-79b4-4119-afe8-29623e666e77 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:51.324946 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-07285300-79b4-4119-afe8-29623e666e77 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047019 Oct 03 14:59:51.325530 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 394/822] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 3 14:59:51 2022] GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:59:51.398733 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-0bda0acf-a585-456a-a86d-9bcedd3f7a6e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:51.399575 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-0bda0acf-a585-456a-a86d-9bcedd3f7a6e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 78499c1b-6aff-4bab-8bc4-495a949e3637] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:51.405947 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0bda0acf-a585-456a-a86d-9bcedd3f7a6e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:51.406490 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0bda0acf-a585-456a-a86d-9bcedd3f7a6e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:51.406924 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0bda0acf-a585-456a-a86d-9bcedd3f7a6e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:51.407684 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0bda0acf-a585-456a-a86d-9bcedd3f7a6e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:51.408143 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0bda0acf-a585-456a-a86d-9bcedd3f7a6e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:51.408600 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0bda0acf-a585-456a-a86d-9bcedd3f7a6e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:51.433741 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-0bda0acf-a585-456a-a86d-9bcedd3f7a6e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 78499c1b-6aff-4bab-8bc4-495a949e3637] Going to try to terminate instance {{(pid=126851) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:59:51.508824 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-0bda0acf-a585-456a-a86d-9bcedd3f7a6e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "DELETE /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637" status: 204 len: 0 microversion: 2.1 time: 0.114402 Oct 03 14:59:51.509419 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 429/823] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 3 14:59:51 2022] DELETE /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:59:51.518279 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-fdaddc81-fcd2-4d40-9242-bbeca9a609df tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:51.518888 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-fdaddc81-fcd2-4d40-9242-bbeca9a609df tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 78499c1b-6aff-4bab-8bc4-495a949e3637] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:51.524611 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fdaddc81-fcd2-4d40-9242-bbeca9a609df tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:51.525084 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fdaddc81-fcd2-4d40-9242-bbeca9a609df tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:51.525539 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fdaddc81-fcd2-4d40-9242-bbeca9a609df tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:51.526222 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fdaddc81-fcd2-4d40-9242-bbeca9a609df tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:51.527178 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fdaddc81-fcd2-4d40-9242-bbeca9a609df tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:51.527814 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fdaddc81-fcd2-4d40-9242-bbeca9a609df tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:51.663021 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-fdaddc81-fcd2-4d40-9242-bbeca9a609df tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:51.670679 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-fdaddc81-fcd2-4d40-9242-bbeca9a609df tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637" status: 200 len: 1680 microversion: 2.1 time: 0.157012 Oct 03 14:59:51.671252 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 395/824] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:51 2022] GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:52.031766 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-9b2e5b93-ce22-4833-9cd4-0ece2eff6f5e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:52.032474 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-9b2e5b93-ce22-4833-9cd4-0ece2eff6f5e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:52.038900 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9b2e5b93-ce22-4833-9cd4-0ece2eff6f5e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:52.039387 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9b2e5b93-ce22-4833-9cd4-0ece2eff6f5e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:52.039826 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9b2e5b93-ce22-4833-9cd4-0ece2eff6f5e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:52.040517 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9b2e5b93-ce22-4833-9cd4-0ece2eff6f5e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:52.041002 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9b2e5b93-ce22-4833-9cd4-0ece2eff6f5e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:52.041430 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9b2e5b93-ce22-4833-9cd4-0ece2eff6f5e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:52.171318 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-9b2e5b93-ce22-4833-9cd4-0ece2eff6f5e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:52.179431 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-9b2e5b93-ce22-4833-9cd4-0ece2eff6f5e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb" status: 200 len: 1362 microversion: 2.1 time: 0.151869 Oct 03 14:59:52.179988 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 430/825] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:52 2022] GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:52.694487 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-2666a07d-8f64-4b33-88d9-62a39a2d16c8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:52.695145 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-2666a07d-8f64-4b33-88d9-62a39a2d16c8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 78499c1b-6aff-4bab-8bc4-495a949e3637] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:52.701715 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2666a07d-8f64-4b33-88d9-62a39a2d16c8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:52.702207 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2666a07d-8f64-4b33-88d9-62a39a2d16c8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:52.702644 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2666a07d-8f64-4b33-88d9-62a39a2d16c8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:52.703834 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2666a07d-8f64-4b33-88d9-62a39a2d16c8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:52.704281 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2666a07d-8f64-4b33-88d9-62a39a2d16c8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:52.704704 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2666a07d-8f64-4b33-88d9-62a39a2d16c8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:52.903168 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-2666a07d-8f64-4b33-88d9-62a39a2d16c8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:52.910723 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-2666a07d-8f64-4b33-88d9-62a39a2d16c8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637" status: 200 len: 1680 microversion: 2.1 time: 0.220394 Oct 03 14:59:52.911286 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 396/826] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:52 2022] GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637 => generated 1680 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:53.201834 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-f7cebede-fea2-4bb5-a6bb-d789108ad9a4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:53.202443 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-f7cebede-fea2-4bb5-a6bb-d789108ad9a4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:53.209351 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f7cebede-fea2-4bb5-a6bb-d789108ad9a4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:53.210810 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f7cebede-fea2-4bb5-a6bb-d789108ad9a4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:53.211253 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f7cebede-fea2-4bb5-a6bb-d789108ad9a4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:53.211949 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f7cebede-fea2-4bb5-a6bb-d789108ad9a4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:53.212409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f7cebede-fea2-4bb5-a6bb-d789108ad9a4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:53.212834 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f7cebede-fea2-4bb5-a6bb-d789108ad9a4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:53.349431 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-f7cebede-fea2-4bb5-a6bb-d789108ad9a4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:53.357190 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-f7cebede-fea2-4bb5-a6bb-d789108ad9a4 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb" status: 200 len: 1362 microversion: 2.1 time: 0.159108 Oct 03 14:59:53.357805 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 431/827] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:53 2022] GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:53.934254 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-1438e4b7-24e8-49c6-93d1-cc6bd33a31f6 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:53.935241 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-1438e4b7-24e8-49c6-93d1-cc6bd33a31f6 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 78499c1b-6aff-4bab-8bc4-495a949e3637] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:53.941445 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1438e4b7-24e8-49c6-93d1-cc6bd33a31f6 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:53.941972 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1438e4b7-24e8-49c6-93d1-cc6bd33a31f6 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:53.942865 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1438e4b7-24e8-49c6-93d1-cc6bd33a31f6 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:53.943571 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1438e4b7-24e8-49c6-93d1-cc6bd33a31f6 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:53.944034 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1438e4b7-24e8-49c6-93d1-cc6bd33a31f6 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:53.944472 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1438e4b7-24e8-49c6-93d1-cc6bd33a31f6 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:54.085230 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-1438e4b7-24e8-49c6-93d1-cc6bd33a31f6 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:54.093312 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-1438e4b7-24e8-49c6-93d1-cc6bd33a31f6 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637" status: 200 len: 1680 microversion: 2.1 time: 0.162862 Oct 03 14:59:54.093909 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 397/828] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:53 2022] GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:54.381512 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-e1fbc261-51b9-483d-a493-150723bfc294 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:54.382437 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-e1fbc261-51b9-483d-a493-150723bfc294 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:54.389770 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e1fbc261-51b9-483d-a493-150723bfc294 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:54.390253 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e1fbc261-51b9-483d-a493-150723bfc294 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:54.390687 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e1fbc261-51b9-483d-a493-150723bfc294 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:54.392022 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e1fbc261-51b9-483d-a493-150723bfc294 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:54.392480 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e1fbc261-51b9-483d-a493-150723bfc294 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:54.392899 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e1fbc261-51b9-483d-a493-150723bfc294 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:54.397163 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:59:54.527178 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-e1fbc261-51b9-483d-a493-150723bfc294 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:54.535295 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-e1fbc261-51b9-483d-a493-150723bfc294 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb" status: 200 len: 1362 microversion: 2.1 time: 0.158420 Oct 03 14:59:54.536125 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 432/829] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:54 2022] GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:55.117725 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-f587e711-bbcf-4f87-911b-1f19c22c869a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:55.118512 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-f587e711-bbcf-4f87-911b-1f19c22c869a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 78499c1b-6aff-4bab-8bc4-495a949e3637] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:55.125356 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f587e711-bbcf-4f87-911b-1f19c22c869a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:55.125924 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f587e711-bbcf-4f87-911b-1f19c22c869a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:55.126422 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f587e711-bbcf-4f87-911b-1f19c22c869a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:55.127131 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f587e711-bbcf-4f87-911b-1f19c22c869a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:55.127629 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f587e711-bbcf-4f87-911b-1f19c22c869a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:55.128058 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f587e711-bbcf-4f87-911b-1f19c22c869a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:55.276394 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-f587e711-bbcf-4f87-911b-1f19c22c869a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:55.285000 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-f587e711-bbcf-4f87-911b-1f19c22c869a tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637" status: 200 len: 1680 microversion: 2.1 time: 0.171350 Oct 03 14:59:55.290281 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 398/830] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:55 2022] GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:55.557404 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-c4aef5e0-9a73-4a2e-b9bd-02baeac5597f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:55.557965 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-c4aef5e0-9a73-4a2e-b9bd-02baeac5597f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:55.564328 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c4aef5e0-9a73-4a2e-b9bd-02baeac5597f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:55.564810 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c4aef5e0-9a73-4a2e-b9bd-02baeac5597f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:55.565248 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c4aef5e0-9a73-4a2e-b9bd-02baeac5597f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:55.565965 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c4aef5e0-9a73-4a2e-b9bd-02baeac5597f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:55.566422 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c4aef5e0-9a73-4a2e-b9bd-02baeac5597f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:55.566845 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c4aef5e0-9a73-4a2e-b9bd-02baeac5597f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:55.695846 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-c4aef5e0-9a73-4a2e-b9bd-02baeac5597f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:55.703370 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-c4aef5e0-9a73-4a2e-b9bd-02baeac5597f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb" status: 200 len: 1362 microversion: 2.1 time: 0.149971 Oct 03 14:59:55.704429 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 433/831] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:55 2022] GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:56.308601 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-4ce02a62-66fa-4ae7-91bd-501b8a32f1ee tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:56.309345 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-4ce02a62-66fa-4ae7-91bd-501b8a32f1ee tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 78499c1b-6aff-4bab-8bc4-495a949e3637] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:56.316261 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4ce02a62-66fa-4ae7-91bd-501b8a32f1ee tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:56.316951 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4ce02a62-66fa-4ae7-91bd-501b8a32f1ee tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:56.317388 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4ce02a62-66fa-4ae7-91bd-501b8a32f1ee tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:56.318198 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4ce02a62-66fa-4ae7-91bd-501b8a32f1ee tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:56.318640 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4ce02a62-66fa-4ae7-91bd-501b8a32f1ee tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:56.319065 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4ce02a62-66fa-4ae7-91bd-501b8a32f1ee tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:56.351199 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell0:SELECT=2 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:59:56.366280 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell0:SELECT=6 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:59:56.499554 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-4ce02a62-66fa-4ae7-91bd-501b8a32f1ee tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:56.511461 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-4ce02a62-66fa-4ae7-91bd-501b8a32f1ee tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637" status: 200 len: 1680 microversion: 2.1 time: 0.206551 Oct 03 14:59:56.512249 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 399/832] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:56 2022] GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637 => generated 1680 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:56.726540 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-0383bbe7-d4a2-4655-a96e-f32787c51a74 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:56.727255 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-0383bbe7-d4a2-4655-a96e-f32787c51a74 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:56.729241 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell0:SELECT=6 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:59:56.735392 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0383bbe7-d4a2-4655-a96e-f32787c51a74 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:56.736531 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0383bbe7-d4a2-4655-a96e-f32787c51a74 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:56.737142 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0383bbe7-d4a2-4655-a96e-f32787c51a74 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:56.738128 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0383bbe7-d4a2-4655-a96e-f32787c51a74 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:56.738518 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0383bbe7-d4a2-4655-a96e-f32787c51a74 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:56.739108 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0383bbe7-d4a2-4655-a96e-f32787c51a74 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:56.876655 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-0383bbe7-d4a2-4655-a96e-f32787c51a74 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:56.884820 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-0383bbe7-d4a2-4655-a96e-f32787c51a74 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb" status: 200 len: 1362 microversion: 2.1 time: 0.162061 Oct 03 14:59:56.885408 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 434/833] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:56 2022] GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:57.470278 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-d1e5d006-f85a-4661-a9b7-9ea5a3780cdf req-55f38690-3004-4fa7-8168-410159680e89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78499c1b-6aff-4bab-8bc4-495a949e3637", "name": "network-vif-deleted", "tag": "328cb0d5-d75b-4a12-a5bf-4bf57d2686b1"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:59:57.483360 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-d1e5d006-f85a-4661-a9b7-9ea5a3780cdf req-55f38690-3004-4fa7-8168-410159680e89 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:57.483843 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-d1e5d006-f85a-4661-a9b7-9ea5a3780cdf req-55f38690-3004-4fa7-8168-410159680e89 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:57.484301 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-d1e5d006-f85a-4661-a9b7-9ea5a3780cdf req-55f38690-3004-4fa7-8168-410159680e89 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:57.498782 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-d1e5d006-f85a-4661-a9b7-9ea5a3780cdf req-55f38690-3004-4fa7-8168-410159680e89 service nova] Creating event network-vif-deleted:328cb0d5-d75b-4a12-a5bf-4bf57d2686b1 for instance 78499c1b-6aff-4bab-8bc4-495a949e3637 on hv-cinder-85987 Oct 03 14:59:57.505766 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-d1e5d006-f85a-4661-a9b7-9ea5a3780cdf req-55f38690-3004-4fa7-8168-410159680e89 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039665 Oct 03 14:59:57.506380 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 400/834] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:59:57.537353 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-d98ac75d-7035-409c-ad02-c85539fa214d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:57.539053 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-d98ac75d-7035-409c-ad02-c85539fa214d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 78499c1b-6aff-4bab-8bc4-495a949e3637] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:57.552288 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d98ac75d-7035-409c-ad02-c85539fa214d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:57.552941 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d98ac75d-7035-409c-ad02-c85539fa214d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:57.553486 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d98ac75d-7035-409c-ad02-c85539fa214d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:57.554354 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d98ac75d-7035-409c-ad02-c85539fa214d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:57.554913 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d98ac75d-7035-409c-ad02-c85539fa214d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:57.555444 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d98ac75d-7035-409c-ad02-c85539fa214d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:57.631186 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-d98ac75d-7035-409c-ad02-c85539fa214d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:57.640147 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-d98ac75d-7035-409c-ad02-c85539fa214d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637" status: 200 len: 1327 microversion: 2.1 time: 0.107486 Oct 03 14:59:57.641183 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 435/835] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:57 2022] GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637 => generated 1327 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:57.908565 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-6b700d7c-7677-4f13-9acc-ef995ebd3a67 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:57.909270 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-6b700d7c-7677-4f13-9acc-ef995ebd3a67 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:57.915719 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6b700d7c-7677-4f13-9acc-ef995ebd3a67 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:57.916210 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6b700d7c-7677-4f13-9acc-ef995ebd3a67 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:57.916651 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6b700d7c-7677-4f13-9acc-ef995ebd3a67 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:57.917362 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6b700d7c-7677-4f13-9acc-ef995ebd3a67 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:57.917854 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6b700d7c-7677-4f13-9acc-ef995ebd3a67 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:57.918285 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6b700d7c-7677-4f13-9acc-ef995ebd3a67 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:58.074595 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-6b700d7c-7677-4f13-9acc-ef995ebd3a67 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:58.083272 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-6b700d7c-7677-4f13-9acc-ef995ebd3a67 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb" status: 200 len: 1362 microversion: 2.1 time: 0.178847 Oct 03 14:59:58.084313 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 401/836] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:57 2022] GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:58.555420 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-90e77087-631d-4ed7-a87c-69dd0a45771e req-83ffadba-dd9b-49ba-b5e3-cf3033729aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cf56714-ab05-4dc1-ae52-0100ec2d6aeb", "name": "network-vif-plugged", "status": "completed", "tag": "94d80152-f32d-4385-b2c7-39409ac0316c"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:59:58.567001 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-90e77087-631d-4ed7-a87c-69dd0a45771e req-83ffadba-dd9b-49ba-b5e3-cf3033729aa8 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:58.567492 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-90e77087-631d-4ed7-a87c-69dd0a45771e req-83ffadba-dd9b-49ba-b5e3-cf3033729aa8 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:58.567925 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-90e77087-631d-4ed7-a87c-69dd0a45771e req-83ffadba-dd9b-49ba-b5e3-cf3033729aa8 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:58.580566 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-90e77087-631d-4ed7-a87c-69dd0a45771e req-83ffadba-dd9b-49ba-b5e3-cf3033729aa8 service nova] Creating event network-vif-plugged:94d80152-f32d-4385-b2c7-39409ac0316c for instance 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb on hv-cinder-85987 Oct 03 14:59:58.586387 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-90e77087-631d-4ed7-a87c-69dd0a45771e req-83ffadba-dd9b-49ba-b5e3-cf3033729aa8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035773 Oct 03 14:59:58.587284 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 436/837] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 14:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:59:58.668078 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-9263223f-ddec-47d7-ba13-f6b3195b815d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:58.668798 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-9263223f-ddec-47d7-ba13-f6b3195b815d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 78499c1b-6aff-4bab-8bc4-495a949e3637] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:58.677536 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9263223f-ddec-47d7-ba13-f6b3195b815d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:58.678249 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9263223f-ddec-47d7-ba13-f6b3195b815d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:58.678849 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9263223f-ddec-47d7-ba13-f6b3195b815d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:58.679722 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9263223f-ddec-47d7-ba13-f6b3195b815d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:58.680283 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9263223f-ddec-47d7-ba13-f6b3195b815d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:58.680806 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9263223f-ddec-47d7-ba13-f6b3195b815d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:58.698967 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.wsgi [None req-9263223f-ddec-47d7-ba13-f6b3195b815d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] HTTP exception thrown: Instance 78499c1b-6aff-4bab-8bc4-495a949e3637 could not be found. Oct 03 14:59:58.701425 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-9263223f-ddec-47d7-ba13-f6b3195b815d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Request method failure captured: Oct 03 14:59:58.701425 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: request: GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637 HTTP/1.1 Oct 03 14:59:58.701425 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept: application/json Oct 03 14:59:58.701425 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept-Encoding: identity Oct 03 14:59:58.701425 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Connection: close Oct 03 14:59:58.701425 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Length: 0 Oct 03 14:59:58.701425 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Type: application/json Oct 03 14:59:58.701425 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Host: 10.222.0.46 Oct 03 14:59:58.701425 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Openstack-System-Scope: None Oct 03 14:59:58.701425 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: User-Agent: python-urllib3/1.26.12 Oct 03 14:59:58.701425 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Auth-Token: gAAAAABjOvcPpmkNazTZsKwP_dytsSc1mWeaFG9s70fvVPaYpq_ArFEvYfc7mC1blzmQmSzzs7KJ6XurvcTxRDIyBJ5kvUsRB0YKc-UpccrxHapwKNSjylJR67P3ZaQN5jh2ABzG340CmXB66R8211hYQUHG14HaVU9UDOYI7_9tJ27nTjX-zUs Oct 03 14:59:58.701425 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Id: None Oct 03 14:59:58.701425 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Name: None Oct 03 14:59:58.701425 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Identity-Status: Confirmed Oct 03 14:59:58.701425 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Is-Admin-Project: True Oct 03 14:59:58.701425 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Id: default Oct 03 14:59:58.701425 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Name: Default Oct 03 14:59:58.701425 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Id: f441c0592cd146d3be851ac96cbc49dc Oct 03 14:59:58.701425 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Name: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 14:59:58.701425 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Role: member,reader Oct 03 14:59:58.701425 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Roles: member,reader Oct 03 14:59:58.702820 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 14:59:58.702820 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 14:59:58.702820 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Id: f441c0592cd146d3be851ac96cbc49dc Oct 03 14:59:58.702820 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 14:59:58.702820 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User: tempest-AttachVolumeNegativeTest-1566300421-project Oct 03 14:59:58.702820 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Id: default Oct 03 14:59:58.702820 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Name: Default Oct 03 14:59:58.702820 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Id: 89c747f18b434e469ae61755e9f639ca Oct 03 14:59:58.702820 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Name: tempest-AttachVolumeNegativeTest-1566300421-project Oct 03 14:59:58.702820 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: method: > Oct 03 14:59:58.702820 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: exception: Instance 78499c1b-6aff-4bab-8bc4-495a949e3637 could not be found. Oct 03 14:59:58.702820 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: action_args: {'id': '78499c1b-6aff-4bab-8bc4-495a949e3637'} Oct 03 14:59:58.704119 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:59:58.704119 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:58.704119 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:59:58.704119 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:59:58.704119 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:59:58.704119 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:59:58.704119 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:59:58.704119 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:59:58.704119 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:59:58.704119 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:59:58.704119 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78499c1b-6aff-4bab-8bc4-495a949e3637 could not be found. Oct 03 14:59:58.704119 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:59:58.704119 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:58.704119 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:59:58.704119 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:58.704119 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:59:58.704119 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:59:58.704119 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:59:58.704119 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:59:58.704119 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:59:58.705287 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:59:58.705287 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:59:58.705287 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:59:58.705287 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:59:58.705287 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:59:58.705287 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:59:58.705287 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:59:58.705287 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78499c1b-6aff-4bab-8bc4-495a949e3637 could not be found. Oct 03 14:59:58.705287 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:59:58.705287 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:58.705287 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:59:58.705287 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:58.705287 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:59:58.705287 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:59:58.705287 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:59:58.705287 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:59:58.705287 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78499c1b-6aff-4bab-8bc4-495a949e3637 could not be found. Oct 03 14:59:58.705287 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 14:59:58.708046 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-9263223f-ddec-47d7-ba13-f6b3195b815d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Returning 404 to user: Instance 78499c1b-6aff-4bab-8bc4-495a949e3637 could not be found. {{(pid=126852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:59:58.709453 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-9263223f-ddec-47d7-ba13-f6b3195b815d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637" status: 404 len: 111 microversion: 2.1 time: 0.045448 Oct 03 14:59:58.710532 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 402/838] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:58 2022] GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:59:58.720807 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-8a8c6460-b7d7-4172-8d19-6e120aa39e97 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '.version_select at 0x7fe0d6cf1430>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:58.743445 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-8a8c6460-b7d7-4172-8d19-6e120aa39e97 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1803949040" status: 202 len: 0 microversion: 2.1 time: 0.028449 Oct 03 14:59:58.745253 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 437/839] 10.222.0.46 () {58 vars in 1221 bytes} [Mon Oct 3 14:59:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1803949040 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:59:59.112631 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-b78323a8-48cd-4273-8bd3-bf161b1b7b73 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:59.113376 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-b78323a8-48cd-4273-8bd3-bf161b1b7b73 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:59.120113 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b78323a8-48cd-4273-8bd3-bf161b1b7b73 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:59.121070 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b78323a8-48cd-4273-8bd3-bf161b1b7b73 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:59.121770 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b78323a8-48cd-4273-8bd3-bf161b1b7b73 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:59.122878 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b78323a8-48cd-4273-8bd3-bf161b1b7b73 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:59.124033 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b78323a8-48cd-4273-8bd3-bf161b1b7b73 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:59.124558 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b78323a8-48cd-4273-8bd3-bf161b1b7b73 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:59.334951 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-b78323a8-48cd-4273-8bd3-bf161b1b7b73 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:59.339219 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=100 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:59:59.344912 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-b78323a8-48cd-4273-8bd3-bf161b1b7b73 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb" status: 200 len: 1362 microversion: 2.1 time: 0.236223 Oct 03 14:59:59.345473 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 403/840] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:59 2022] GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb => generated 1362 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:59.542023 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-f3f3136f-76a8-4d2d-9562-8b266d1af309 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Action: 'create', calling method: .version_select at 0x7fe0d6c66b80>, body: {"keypair": {"name": "tempest-keypair-2068502486", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvAcYcyoEJE1Y+nKa0QKnV2Y9Sgpy70wz7ACEb+VsjK4LBSu3T6jlj5g0dyGIYXDZekw0Mx5woD97Y1mcjbMU1wq+IFv0h93j+CXSN+pC+RUgtUlL4G9qYuUuB92KG1AA=="}} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:59:59.563874 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.quota [None req-f3f3136f-76a8-4d2d-9562-8b266d1af309 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Getting quotas for project f441c0592cd146d3be851ac96cbc49dc. Resources: {'key_pairs'} {{(pid=126851) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:59:59.568203 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.quota [None req-f3f3136f-76a8-4d2d-9562-8b266d1af309 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Getting quotas for user 89c747f18b434e469ae61755e9f639ca and project f441c0592cd146d3be851ac96cbc49dc. Resources: {'key_pairs'} {{(pid=126851) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:59:59.589418 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-f3f3136f-76a8-4d2d-9562-8b266d1af309 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051029 Oct 03 14:59:59.590082 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 438/841] 10.222.0.46 () {60 vars in 1159 bytes} [Mon Oct 3 14:59:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:00:00.367431 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-367ace0f-8e8b-45bc-abc9-98d1866e03f2 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:00.367970 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-367ace0f-8e8b-45bc-abc9-98d1866e03f2 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:00.375124 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-367ace0f-8e8b-45bc-abc9-98d1866e03f2 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:00.375754 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-367ace0f-8e8b-45bc-abc9-98d1866e03f2 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:00.376205 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-367ace0f-8e8b-45bc-abc9-98d1866e03f2 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:00.376946 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-367ace0f-8e8b-45bc-abc9-98d1866e03f2 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:00.377410 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-367ace0f-8e8b-45bc-abc9-98d1866e03f2 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:00.377869 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-367ace0f-8e8b-45bc-abc9-98d1866e03f2 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:00.508223 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-367ace0f-8e8b-45bc-abc9-98d1866e03f2 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:00.515954 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-367ace0f-8e8b-45bc-abc9-98d1866e03f2 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb" status: 200 len: 1362 microversion: 2.1 time: 0.152759 Oct 03 15:00:00.516532 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 404/842] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:00 2022] GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:00.894456 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-36125c2b-10dc-4b5e-861b-6ce70050850b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1984447886", "imageRef": "add7a872-2ca1-4366-9a93-f0663fdb297b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3b88fdf3-b260-41ad-9765-7cbb7b33b8ed"}], "security_groups": [{"name": "tempest-securitygroup--944676806"}], "key_name": "tempest-keypair-2068502486", "user_data": "}} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:00:00.995019 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.network.neutron [None req-36125c2b-10dc-4b5e-861b-6ce70050850b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] validate_networks() for [('3b88fdf3-b260-41ad-9765-7cbb7b33b8ed', None, None, None, None, None)] {{(pid=126851) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:00:01.385704 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-36125c2b-10dc-4b5e-861b-6ce70050850b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Flavor limits 0:0:0 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:00:01.386462 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-36125c2b-10dc-4b5e-861b-6ce70050850b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Image limits 0:0:0 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:00:01.387119 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-36125c2b-10dc-4b5e-861b-6ce70050850b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Flavor pref 0:0:0 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:00:01.387613 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-36125c2b-10dc-4b5e-861b-6ce70050850b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Image pref 0:0:0 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:00:01.388240 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-36125c2b-10dc-4b5e-861b-6ce70050850b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:00:01.398198 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-36125c2b-10dc-4b5e-861b-6ce70050850b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:01.398691 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-36125c2b-10dc-4b5e-861b-6ce70050850b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:01.399131 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-36125c2b-10dc-4b5e-861b-6ce70050850b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:01.399862 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-36125c2b-10dc-4b5e-861b-6ce70050850b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:01.400322 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-36125c2b-10dc-4b5e-861b-6ce70050850b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:01.400741 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-36125c2b-10dc-4b5e-861b-6ce70050850b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:01.418559 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.quota [None req-36125c2b-10dc-4b5e-861b-6ce70050850b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Getting quotas for project f441c0592cd146d3be851ac96cbc49dc. Resources: {'ram', 'instances', 'cores'} {{(pid=126851) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:00:01.425527 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.quota [None req-36125c2b-10dc-4b5e-861b-6ce70050850b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Getting quotas for user 89c747f18b434e469ae61755e9f639ca and project f441c0592cd146d3be851ac96cbc49dc. Resources: {'ram', 'instances', 'cores'} {{(pid=126851) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:00:01.437715 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-36125c2b-10dc-4b5e-861b-6ce70050850b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Going to run 1 instances... {{(pid=126851) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:00:01.441381 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-36125c2b-10dc-4b5e-861b-6ce70050850b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 8f9c9350-8239-4025-852c-17a10acd5f57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='add7a872-2ca1-4366-9a93-f0663fdb297b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126851) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:00:01.495796 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-36125c2b-10dc-4b5e-861b-6ce70050850b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.606585 Oct 03 15:00:01.496509 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 439/843] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 3 15:00:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:00:01.508033 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-c3b33704-13e4-4074-86e9-1a8b283028c6 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:01.508649 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-c3b33704-13e4-4074-86e9-1a8b283028c6 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 8f9c9350-8239-4025-852c-17a10acd5f57] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:01.538665 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-eec59a99-361f-4ea3-8f12-609bf2f9ae85 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:01.539612 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-eec59a99-361f-4ea3-8f12-609bf2f9ae85 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:01.546648 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-eec59a99-361f-4ea3-8f12-609bf2f9ae85 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:01.547642 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-eec59a99-361f-4ea3-8f12-609bf2f9ae85 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:01.548081 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-eec59a99-361f-4ea3-8f12-609bf2f9ae85 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:01.548789 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-eec59a99-361f-4ea3-8f12-609bf2f9ae85 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:01.549244 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-eec59a99-361f-4ea3-8f12-609bf2f9ae85 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:01.549704 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-eec59a99-361f-4ea3-8f12-609bf2f9ae85 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:01.571154 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-c3b33704-13e4-4074-86e9-1a8b283028c6 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:01.578210 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-c3b33704-13e4-4074-86e9-1a8b283028c6 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57" status: 200 len: 1242 microversion: 2.1 time: 0.073937 Oct 03 15:00:01.579018 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 405/844] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:01 2022] GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57 => generated 1242 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:01.698410 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-eec59a99-361f-4ea3-8f12-609bf2f9ae85 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:01.707881 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-eec59a99-361f-4ea3-8f12-609bf2f9ae85 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb" status: 200 len: 1548 microversion: 2.1 time: 0.172573 Oct 03 15:00:01.708895 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 440/845] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:01 2022] GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb => generated 1548 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:00:01.730235 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-0b88a7c7-f2cf-4c88-9066-9168ec28770b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:01.730718 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-0b88a7c7-f2cf-4c88-9066-9168ec28770b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:01.747820 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0b88a7c7-f2cf-4c88-9066-9168ec28770b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:01.748323 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0b88a7c7-f2cf-4c88-9066-9168ec28770b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:01.748761 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0b88a7c7-f2cf-4c88-9066-9168ec28770b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:01.749488 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0b88a7c7-f2cf-4c88-9066-9168ec28770b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:01.749953 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0b88a7c7-f2cf-4c88-9066-9168ec28770b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:01.751417 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0b88a7c7-f2cf-4c88-9066-9168ec28770b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:02.058685 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-0b88a7c7-f2cf-4c88-9066-9168ec28770b tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.332255 Oct 03 15:00:02.059293 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 406/846] 10.222.0.46 () {58 vars in 1275 bytes} [Mon Oct 3 15:00:01 2022] GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb/os-interface => generated 284 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:00:02.601035 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-6617104c-06c5-4517-ad95-5016acbc0644 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:02.601743 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-6617104c-06c5-4517-ad95-5016acbc0644 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 8f9c9350-8239-4025-852c-17a10acd5f57] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:02.605168 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:00:02.608726 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6617104c-06c5-4517-ad95-5016acbc0644 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:02.609207 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6617104c-06c5-4517-ad95-5016acbc0644 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:02.610303 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6617104c-06c5-4517-ad95-5016acbc0644 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:02.610997 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6617104c-06c5-4517-ad95-5016acbc0644 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:02.611457 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6617104c-06c5-4517-ad95-5016acbc0644 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:02.611887 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6617104c-06c5-4517-ad95-5016acbc0644 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:02.675202 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-6617104c-06c5-4517-ad95-5016acbc0644 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:02.683914 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-6617104c-06c5-4517-ad95-5016acbc0644 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57" status: 200 len: 1246 microversion: 2.1 time: 0.086704 Oct 03 15:00:02.684688 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 441/847] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:02 2022] GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:02.979963 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-0a2d7f7d-c960-4145-9bc4-71a7d98aa5b0 req-e8c7dae2-9130-4ae2-ba48-2868333ac514 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cf56714-ab05-4dc1-ae52-0100ec2d6aeb", "tag": "94d80152-f32d-4385-b2c7-39409ac0316c"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:00:02.990071 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-0a2d7f7d-c960-4145-9bc4-71a7d98aa5b0 req-e8c7dae2-9130-4ae2-ba48-2868333ac514 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:02.990621 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-0a2d7f7d-c960-4145-9bc4-71a7d98aa5b0 req-e8c7dae2-9130-4ae2-ba48-2868333ac514 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:02.991160 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-0a2d7f7d-c960-4145-9bc4-71a7d98aa5b0 req-e8c7dae2-9130-4ae2-ba48-2868333ac514 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:03.003853 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-0a2d7f7d-c960-4145-9bc4-71a7d98aa5b0 req-e8c7dae2-9130-4ae2-ba48-2868333ac514 service nova] Creating event network-changed:94d80152-f32d-4385-b2c7-39409ac0316c for instance 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb on hv-cinder-85987 Oct 03 15:00:03.008626 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-0a2d7f7d-c960-4145-9bc4-71a7d98aa5b0 req-e8c7dae2-9130-4ae2-ba48-2868333ac514 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032924 Oct 03 15:00:03.009296 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 407/848] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 15:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:00:03.706466 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-8189a794-a375-4123-a321-56aa055031f5 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:03.707349 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-8189a794-a375-4123-a321-56aa055031f5 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 8f9c9350-8239-4025-852c-17a10acd5f57] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:03.713982 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8189a794-a375-4123-a321-56aa055031f5 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:03.714473 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8189a794-a375-4123-a321-56aa055031f5 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:03.714918 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8189a794-a375-4123-a321-56aa055031f5 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:03.715654 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8189a794-a375-4123-a321-56aa055031f5 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:03.716118 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8189a794-a375-4123-a321-56aa055031f5 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:03.716543 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8189a794-a375-4123-a321-56aa055031f5 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:03.777610 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-8189a794-a375-4123-a321-56aa055031f5 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:03.785573 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-8189a794-a375-4123-a321-56aa055031f5 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57" status: 200 len: 1246 microversion: 2.1 time: 0.083471 Oct 03 15:00:03.786152 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 442/849] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:03 2022] GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:04.809071 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-3330498d-e7fa-4604-8237-6ed4977aacb8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:04.809803 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-3330498d-e7fa-4604-8237-6ed4977aacb8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 8f9c9350-8239-4025-852c-17a10acd5f57] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:04.815875 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3330498d-e7fa-4604-8237-6ed4977aacb8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:04.816357 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3330498d-e7fa-4604-8237-6ed4977aacb8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:04.816797 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3330498d-e7fa-4604-8237-6ed4977aacb8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:04.817482 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3330498d-e7fa-4604-8237-6ed4977aacb8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:04.817962 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3330498d-e7fa-4604-8237-6ed4977aacb8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:04.818383 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3330498d-e7fa-4604-8237-6ed4977aacb8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:04.879844 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-3330498d-e7fa-4604-8237-6ed4977aacb8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:04.887441 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-3330498d-e7fa-4604-8237-6ed4977aacb8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57" status: 200 len: 1246 microversion: 2.1 time: 0.083027 Oct 03 15:00:04.888002 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 408/850] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:04 2022] GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:05.910344 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-1e7bab35-afcc-42a4-ac6c-e1a907806b1d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:05.911040 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-1e7bab35-afcc-42a4-ac6c-e1a907806b1d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 8f9c9350-8239-4025-852c-17a10acd5f57] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:05.918401 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1e7bab35-afcc-42a4-ac6c-e1a907806b1d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:05.918885 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1e7bab35-afcc-42a4-ac6c-e1a907806b1d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:05.919318 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1e7bab35-afcc-42a4-ac6c-e1a907806b1d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:05.920019 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1e7bab35-afcc-42a4-ac6c-e1a907806b1d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:05.920457 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1e7bab35-afcc-42a4-ac6c-e1a907806b1d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:05.920872 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1e7bab35-afcc-42a4-ac6c-e1a907806b1d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:06.001649 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-1e7bab35-afcc-42a4-ac6c-e1a907806b1d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:06.009222 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-1e7bab35-afcc-42a4-ac6c-e1a907806b1d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57" status: 200 len: 1238 microversion: 2.1 time: 0.102629 Oct 03 15:00:06.009813 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 443/851] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:05 2022] GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57 => generated 1238 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:07.032788 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-1b571d45-e0e0-4a0c-ab81-12a1f03091fc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:07.033397 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-1b571d45-e0e0-4a0c-ab81-12a1f03091fc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 8f9c9350-8239-4025-852c-17a10acd5f57] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:07.046807 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1b571d45-e0e0-4a0c-ab81-12a1f03091fc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:07.048205 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1b571d45-e0e0-4a0c-ab81-12a1f03091fc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:07.048651 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1b571d45-e0e0-4a0c-ab81-12a1f03091fc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:07.049398 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1b571d45-e0e0-4a0c-ab81-12a1f03091fc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:07.050039 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1b571d45-e0e0-4a0c-ab81-12a1f03091fc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:07.050664 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1b571d45-e0e0-4a0c-ab81-12a1f03091fc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:07.114549 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-1b571d45-e0e0-4a0c-ab81-12a1f03091fc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:07.121949 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-1b571d45-e0e0-4a0c-ab81-12a1f03091fc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57" status: 200 len: 1300 microversion: 2.1 time: 0.093684 Oct 03 15:00:07.122503 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 409/852] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:07 2022] GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57 => generated 1300 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:08.145786 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-1fd47470-a20c-4cac-b4b8-9865bd690021 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:08.146325 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-1fd47470-a20c-4cac-b4b8-9865bd690021 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 8f9c9350-8239-4025-852c-17a10acd5f57] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:08.152748 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1fd47470-a20c-4cac-b4b8-9865bd690021 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:08.153232 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1fd47470-a20c-4cac-b4b8-9865bd690021 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:08.153693 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1fd47470-a20c-4cac-b4b8-9865bd690021 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:08.154384 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1fd47470-a20c-4cac-b4b8-9865bd690021 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:08.154840 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1fd47470-a20c-4cac-b4b8-9865bd690021 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:08.155263 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1fd47470-a20c-4cac-b4b8-9865bd690021 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:08.213776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-1fd47470-a20c-4cac-b4b8-9865bd690021 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:08.221751 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-1fd47470-a20c-4cac-b4b8-9865bd690021 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57" status: 200 len: 1300 microversion: 2.1 time: 0.079802 Oct 03 15:00:08.222310 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 444/853] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:08 2022] GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57 => generated 1300 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:09.244676 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-fe671504-dfcb-40f4-ab2c-357c2cf35a80 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:09.245293 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-fe671504-dfcb-40f4-ab2c-357c2cf35a80 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 8f9c9350-8239-4025-852c-17a10acd5f57] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:09.251799 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fe671504-dfcb-40f4-ab2c-357c2cf35a80 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:09.252283 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fe671504-dfcb-40f4-ab2c-357c2cf35a80 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:09.252721 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fe671504-dfcb-40f4-ab2c-357c2cf35a80 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:09.253413 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fe671504-dfcb-40f4-ab2c-357c2cf35a80 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:09.253989 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fe671504-dfcb-40f4-ab2c-357c2cf35a80 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:09.254432 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-fe671504-dfcb-40f4-ab2c-357c2cf35a80 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:09.315293 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-fe671504-dfcb-40f4-ab2c-357c2cf35a80 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:09.323316 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-fe671504-dfcb-40f4-ab2c-357c2cf35a80 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57" status: 200 len: 1300 microversion: 2.1 time: 0.082451 Oct 03 15:00:09.323911 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 410/854] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:09 2022] GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57 => generated 1300 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:10.347346 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-d48e8e70-efc5-431d-a9ee-543dc645b176 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:10.347970 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-d48e8e70-efc5-431d-a9ee-543dc645b176 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 8f9c9350-8239-4025-852c-17a10acd5f57] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:10.354382 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d48e8e70-efc5-431d-a9ee-543dc645b176 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:10.354862 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d48e8e70-efc5-431d-a9ee-543dc645b176 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:10.355300 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d48e8e70-efc5-431d-a9ee-543dc645b176 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:10.355990 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d48e8e70-efc5-431d-a9ee-543dc645b176 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:10.356449 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d48e8e70-efc5-431d-a9ee-543dc645b176 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:10.356879 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d48e8e70-efc5-431d-a9ee-543dc645b176 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:10.416252 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-d48e8e70-efc5-431d-a9ee-543dc645b176 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:10.424357 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-d48e8e70-efc5-431d-a9ee-543dc645b176 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57" status: 200 len: 1300 microversion: 2.1 time: 0.081372 Oct 03 15:00:10.424924 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 445/855] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:10 2022] GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57 => generated 1300 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:11.446856 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-696085ed-0cd1-46f2-bf99-563e4aecbf32 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:11.447481 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-696085ed-0cd1-46f2-bf99-563e4aecbf32 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 8f9c9350-8239-4025-852c-17a10acd5f57] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:11.450023 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:00:11.455040 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-696085ed-0cd1-46f2-bf99-563e4aecbf32 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:11.455603 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-696085ed-0cd1-46f2-bf99-563e4aecbf32 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:11.456113 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-696085ed-0cd1-46f2-bf99-563e4aecbf32 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:11.457130 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-696085ed-0cd1-46f2-bf99-563e4aecbf32 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:11.457693 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-696085ed-0cd1-46f2-bf99-563e4aecbf32 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:11.458211 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-696085ed-0cd1-46f2-bf99-563e4aecbf32 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:11.578486 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell0:SELECT=2 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:00:11.670932 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-696085ed-0cd1-46f2-bf99-563e4aecbf32 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:11.680650 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-696085ed-0cd1-46f2-bf99-563e4aecbf32 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57" status: 200 len: 1367 microversion: 2.1 time: 0.237675 Oct 03 15:00:11.693954 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 411/856] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:11 2022] GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57 => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:11.984912 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-494cceca-44aa-4120-b6b0-c251f6022aba req-17c45374-485f-49df-a01d-6aee8b8165db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f9c9350-8239-4025-852c-17a10acd5f57", "tag": "97ee8f9f-5e7f-49f2-afe8-8afadaf3dfba"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:00:11.994001 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell0:SELECT=2 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:00:11.995140 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell0:SELECT=10 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:00:11.997841 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-494cceca-44aa-4120-b6b0-c251f6022aba req-17c45374-485f-49df-a01d-6aee8b8165db service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:11.998485 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-494cceca-44aa-4120-b6b0-c251f6022aba req-17c45374-485f-49df-a01d-6aee8b8165db service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:11.999128 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-494cceca-44aa-4120-b6b0-c251f6022aba req-17c45374-485f-49df-a01d-6aee8b8165db service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:12.015508 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-494cceca-44aa-4120-b6b0-c251f6022aba req-17c45374-485f-49df-a01d-6aee8b8165db service nova] Creating event network-changed:97ee8f9f-5e7f-49f2-afe8-8afadaf3dfba for instance 8f9c9350-8239-4025-852c-17a10acd5f57 on hv-cinder-85987 Oct 03 15:00:12.022142 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-494cceca-44aa-4120-b6b0-c251f6022aba req-17c45374-485f-49df-a01d-6aee8b8165db service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040846 Oct 03 15:00:12.022772 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 446/857] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 15:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:00:12.703058 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-94708059-2d50-4514-9273-81194d7d2746 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:12.704198 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-94708059-2d50-4514-9273-81194d7d2746 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 8f9c9350-8239-4025-852c-17a10acd5f57] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:12.711000 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-94708059-2d50-4514-9273-81194d7d2746 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:12.711485 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-94708059-2d50-4514-9273-81194d7d2746 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:12.711927 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-94708059-2d50-4514-9273-81194d7d2746 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:12.712623 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-94708059-2d50-4514-9273-81194d7d2746 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:12.713080 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-94708059-2d50-4514-9273-81194d7d2746 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:12.713559 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-94708059-2d50-4514-9273-81194d7d2746 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:12.846255 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-94708059-2d50-4514-9273-81194d7d2746 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:12.853953 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-94708059-2d50-4514-9273-81194d7d2746 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57" status: 200 len: 1367 microversion: 2.1 time: 0.154751 Oct 03 15:00:12.854524 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 412/858] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:12 2022] GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:13.879018 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-3b4cf0c3-899b-4e7c-9310-4381e0d4e80f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:13.879579 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-3b4cf0c3-899b-4e7c-9310-4381e0d4e80f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 8f9c9350-8239-4025-852c-17a10acd5f57] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:13.885273 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3b4cf0c3-899b-4e7c-9310-4381e0d4e80f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:13.885792 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3b4cf0c3-899b-4e7c-9310-4381e0d4e80f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:13.886230 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3b4cf0c3-899b-4e7c-9310-4381e0d4e80f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:13.886918 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3b4cf0c3-899b-4e7c-9310-4381e0d4e80f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:13.887374 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3b4cf0c3-899b-4e7c-9310-4381e0d4e80f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:13.887800 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3b4cf0c3-899b-4e7c-9310-4381e0d4e80f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:14.020091 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-3b4cf0c3-899b-4e7c-9310-4381e0d4e80f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:14.027631 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-3b4cf0c3-899b-4e7c-9310-4381e0d4e80f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57" status: 200 len: 1367 microversion: 2.1 time: 0.154486 Oct 03 15:00:14.028200 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 447/859] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:13 2022] GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:15.050249 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-49105eb6-0682-4365-8407-17202b53e695 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:15.050895 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-49105eb6-0682-4365-8407-17202b53e695 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 8f9c9350-8239-4025-852c-17a10acd5f57] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:15.057301 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-49105eb6-0682-4365-8407-17202b53e695 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:15.057816 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-49105eb6-0682-4365-8407-17202b53e695 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:15.058255 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-49105eb6-0682-4365-8407-17202b53e695 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:15.058943 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-49105eb6-0682-4365-8407-17202b53e695 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:15.059399 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-49105eb6-0682-4365-8407-17202b53e695 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:15.059822 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-49105eb6-0682-4365-8407-17202b53e695 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:15.189847 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-49105eb6-0682-4365-8407-17202b53e695 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:15.197405 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-49105eb6-0682-4365-8407-17202b53e695 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57" status: 200 len: 1367 microversion: 2.1 time: 0.151001 Oct 03 15:00:15.198002 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 413/860] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:15 2022] GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:16.221188 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-de119644-f615-423f-89a7-4ca68006af2c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:16.221745 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-de119644-f615-423f-89a7-4ca68006af2c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 8f9c9350-8239-4025-852c-17a10acd5f57] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:16.228201 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-de119644-f615-423f-89a7-4ca68006af2c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:16.228691 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-de119644-f615-423f-89a7-4ca68006af2c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:16.229131 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-de119644-f615-423f-89a7-4ca68006af2c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:16.229854 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-de119644-f615-423f-89a7-4ca68006af2c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:16.230302 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-de119644-f615-423f-89a7-4ca68006af2c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:16.230726 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-de119644-f615-423f-89a7-4ca68006af2c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:16.354633 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-de119644-f615-423f-89a7-4ca68006af2c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:16.362730 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-de119644-f615-423f-89a7-4ca68006af2c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57" status: 200 len: 1367 microversion: 2.1 time: 0.145975 Oct 03 15:00:16.363294 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 448/861] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:16 2022] GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:17.385021 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-3d57c210-3a2c-4a56-9151-acfb64fa4e8f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:17.385662 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-3d57c210-3a2c-4a56-9151-acfb64fa4e8f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 8f9c9350-8239-4025-852c-17a10acd5f57] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:17.392030 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3d57c210-3a2c-4a56-9151-acfb64fa4e8f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:17.392501 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3d57c210-3a2c-4a56-9151-acfb64fa4e8f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:17.392926 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3d57c210-3a2c-4a56-9151-acfb64fa4e8f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:17.393635 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3d57c210-3a2c-4a56-9151-acfb64fa4e8f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:17.394085 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3d57c210-3a2c-4a56-9151-acfb64fa4e8f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:17.394501 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3d57c210-3a2c-4a56-9151-acfb64fa4e8f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:17.779750 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-3d57c210-3a2c-4a56-9151-acfb64fa4e8f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:17.787832 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-3d57c210-3a2c-4a56-9151-acfb64fa4e8f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57" status: 200 len: 1367 microversion: 2.1 time: 0.406664 Oct 03 15:00:17.788391 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 414/862] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:17 2022] GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57 => generated 1367 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:18.811013 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-d03608ae-8988-414e-a64b-1ff0aa1ce46d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:18.811628 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-d03608ae-8988-414e-a64b-1ff0aa1ce46d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 8f9c9350-8239-4025-852c-17a10acd5f57] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:18.818483 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d03608ae-8988-414e-a64b-1ff0aa1ce46d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:18.818965 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d03608ae-8988-414e-a64b-1ff0aa1ce46d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:18.819401 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d03608ae-8988-414e-a64b-1ff0aa1ce46d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:18.820098 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d03608ae-8988-414e-a64b-1ff0aa1ce46d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:18.820552 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d03608ae-8988-414e-a64b-1ff0aa1ce46d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:18.820976 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d03608ae-8988-414e-a64b-1ff0aa1ce46d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:18.949425 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-d03608ae-8988-414e-a64b-1ff0aa1ce46d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:18.957460 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-d03608ae-8988-414e-a64b-1ff0aa1ce46d tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57" status: 200 len: 1367 microversion: 2.1 time: 0.150270 Oct 03 15:00:18.958265 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 449/863] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:18 2022] GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:19.979214 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-8687fa60-bf92-49ee-8274-90ef07179efc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:19.979823 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-8687fa60-bf92-49ee-8274-90ef07179efc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 8f9c9350-8239-4025-852c-17a10acd5f57] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:19.986321 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8687fa60-bf92-49ee-8274-90ef07179efc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:19.986802 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8687fa60-bf92-49ee-8274-90ef07179efc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:19.987228 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8687fa60-bf92-49ee-8274-90ef07179efc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:19.988097 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8687fa60-bf92-49ee-8274-90ef07179efc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:19.988548 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8687fa60-bf92-49ee-8274-90ef07179efc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:19.988966 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8687fa60-bf92-49ee-8274-90ef07179efc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:20.134873 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-8687fa60-bf92-49ee-8274-90ef07179efc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:20.143936 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-8687fa60-bf92-49ee-8274-90ef07179efc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57" status: 200 len: 1367 microversion: 2.1 time: 0.168500 Oct 03 15:00:20.144517 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 415/864] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:19 2022] GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:20.968656 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-15d2a1dd-dd56-4c51-a5c0-172cdf30b066 req-745282e1-b5c0-40b3-acf3-658f2abd9b07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f9c9350-8239-4025-852c-17a10acd5f57", "name": "network-vif-plugged", "status": "completed", "tag": "97ee8f9f-5e7f-49f2-afe8-8afadaf3dfba"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:00:20.978971 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-15d2a1dd-dd56-4c51-a5c0-172cdf30b066 req-745282e1-b5c0-40b3-acf3-658f2abd9b07 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:20.979449 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-15d2a1dd-dd56-4c51-a5c0-172cdf30b066 req-745282e1-b5c0-40b3-acf3-658f2abd9b07 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:20.979883 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-15d2a1dd-dd56-4c51-a5c0-172cdf30b066 req-745282e1-b5c0-40b3-acf3-658f2abd9b07 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:20.992009 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-15d2a1dd-dd56-4c51-a5c0-172cdf30b066 req-745282e1-b5c0-40b3-acf3-658f2abd9b07 service nova] Creating event network-vif-plugged:97ee8f9f-5e7f-49f2-afe8-8afadaf3dfba for instance 8f9c9350-8239-4025-852c-17a10acd5f57 on hv-cinder-85987 Oct 03 15:00:20.997247 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-15d2a1dd-dd56-4c51-a5c0-172cdf30b066 req-745282e1-b5c0-40b3-acf3-658f2abd9b07 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032253 Oct 03 15:00:20.998036 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 450/865] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 15:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:00:21.168598 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-968fa07a-71a3-4068-ba11-69ca7dc43515 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:21.169252 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-968fa07a-71a3-4068-ba11-69ca7dc43515 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 8f9c9350-8239-4025-852c-17a10acd5f57] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:21.177082 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-968fa07a-71a3-4068-ba11-69ca7dc43515 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:21.177599 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-968fa07a-71a3-4068-ba11-69ca7dc43515 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:21.178035 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-968fa07a-71a3-4068-ba11-69ca7dc43515 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:21.178732 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-968fa07a-71a3-4068-ba11-69ca7dc43515 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:21.179785 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-968fa07a-71a3-4068-ba11-69ca7dc43515 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:21.180238 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-968fa07a-71a3-4068-ba11-69ca7dc43515 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:21.383210 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-968fa07a-71a3-4068-ba11-69ca7dc43515 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:21.390804 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-968fa07a-71a3-4068-ba11-69ca7dc43515 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57" status: 200 len: 1367 microversion: 2.1 time: 0.227872 Oct 03 15:00:21.391370 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 416/866] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:21 2022] GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57 => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:22.414457 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-8e36d6c6-053a-4f75-8ba0-88f95d449b2c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:22.415158 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-8e36d6c6-053a-4f75-8ba0-88f95d449b2c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 8f9c9350-8239-4025-852c-17a10acd5f57] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:22.421299 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8e36d6c6-053a-4f75-8ba0-88f95d449b2c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:22.421812 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8e36d6c6-053a-4f75-8ba0-88f95d449b2c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:22.422253 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8e36d6c6-053a-4f75-8ba0-88f95d449b2c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:22.422947 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8e36d6c6-053a-4f75-8ba0-88f95d449b2c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:22.423905 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8e36d6c6-053a-4f75-8ba0-88f95d449b2c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:22.424331 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8e36d6c6-053a-4f75-8ba0-88f95d449b2c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:22.563482 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-8e36d6c6-053a-4f75-8ba0-88f95d449b2c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:22.571786 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-8e36d6c6-053a-4f75-8ba0-88f95d449b2c tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57" status: 200 len: 1367 microversion: 2.1 time: 0.162093 Oct 03 15:00:22.572362 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 451/867] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:22 2022] GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:23.594310 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-9141f76e-b9f2-43e7-8f7d-77520a928200 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:23.594834 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-9141f76e-b9f2-43e7-8f7d-77520a928200 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 8f9c9350-8239-4025-852c-17a10acd5f57] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:23.601723 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9141f76e-b9f2-43e7-8f7d-77520a928200 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:23.602220 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9141f76e-b9f2-43e7-8f7d-77520a928200 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:23.602637 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9141f76e-b9f2-43e7-8f7d-77520a928200 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:23.603320 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9141f76e-b9f2-43e7-8f7d-77520a928200 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:23.603781 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9141f76e-b9f2-43e7-8f7d-77520a928200 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:23.604203 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9141f76e-b9f2-43e7-8f7d-77520a928200 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:23.737571 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-9141f76e-b9f2-43e7-8f7d-77520a928200 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:23.745353 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-9141f76e-b9f2-43e7-8f7d-77520a928200 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57" status: 200 len: 1557 microversion: 2.1 time: 0.154974 Oct 03 15:00:23.745963 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 417/868] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:23 2022] GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:23.768717 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-f0bac986-e475-4c60-a240-dbb1574f61f7 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:23.769236 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-f0bac986-e475-4c60-a240-dbb1574f61f7 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 8f9c9350-8239-4025-852c-17a10acd5f57] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:23.776789 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f0bac986-e475-4c60-a240-dbb1574f61f7 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:23.777266 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f0bac986-e475-4c60-a240-dbb1574f61f7 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:23.777721 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f0bac986-e475-4c60-a240-dbb1574f61f7 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:23.778581 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f0bac986-e475-4c60-a240-dbb1574f61f7 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:23.779208 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f0bac986-e475-4c60-a240-dbb1574f61f7 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:23.779629 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f0bac986-e475-4c60-a240-dbb1574f61f7 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:23.856642 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-f0bac986-e475-4c60-a240-dbb1574f61f7 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092680 Oct 03 15:00:23.857334 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 452/869] 10.222.0.46 () {58 vars in 1275 bytes} [Mon Oct 3 15:00:23 2022] GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:00:24.863756 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-94ff02d5-6be1-42a1-a549-9a2f5bef9551 req-b5dc7094-0eba-49ca-8813-0129de2009ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f9c9350-8239-4025-852c-17a10acd5f57", "tag": "97ee8f9f-5e7f-49f2-afe8-8afadaf3dfba"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:00:24.873690 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-94ff02d5-6be1-42a1-a549-9a2f5bef9551 req-b5dc7094-0eba-49ca-8813-0129de2009ad service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:24.874174 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-94ff02d5-6be1-42a1-a549-9a2f5bef9551 req-b5dc7094-0eba-49ca-8813-0129de2009ad service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:24.874612 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-94ff02d5-6be1-42a1-a549-9a2f5bef9551 req-b5dc7094-0eba-49ca-8813-0129de2009ad service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:24.885287 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-94ff02d5-6be1-42a1-a549-9a2f5bef9551 req-b5dc7094-0eba-49ca-8813-0129de2009ad service nova] Creating event network-changed:97ee8f9f-5e7f-49f2-afe8-8afadaf3dfba for instance 8f9c9350-8239-4025-852c-17a10acd5f57 on hv-cinder-85987 Oct 03 15:00:24.890399 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-94ff02d5-6be1-42a1-a549-9a2f5bef9551 req-b5dc7094-0eba-49ca-8813-0129de2009ad service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030342 Oct 03 15:00:24.891076 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 418/870] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 15:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:00:28.453653 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-77560d0f-c079-4497-bec3-f0b5d35ddcd6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:28.454189 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-77560d0f-c079-4497-bec3-f0b5d35ddcd6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:28.460326 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-77560d0f-c079-4497-bec3-f0b5d35ddcd6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:28.460805 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-77560d0f-c079-4497-bec3-f0b5d35ddcd6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:28.461237 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-77560d0f-c079-4497-bec3-f0b5d35ddcd6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:28.461944 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-77560d0f-c079-4497-bec3-f0b5d35ddcd6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:28.462401 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-77560d0f-c079-4497-bec3-f0b5d35ddcd6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:28.462825 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-77560d0f-c079-4497-bec3-f0b5d35ddcd6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:28.465206 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=95 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:00:28.486791 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-77560d0f-c079-4497-bec3-f0b5d35ddcd6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9/ips" status: 200 len: 153 microversion: 2.20 time: 0.037589 Oct 03 15:00:28.487349 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 453/871] 10.222.0.46 () {60 vars in 1289 bytes} [Mon Oct 3 15:00:28 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9/ips => generated 153 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:00:30.693028 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-76431575-c2b2-4580-8d30-3061246cc3f8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:00:30.693687 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-76431575-c2b2-4580-8d30-3061246cc3f8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:30.699746 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-76431575-c2b2-4580-8d30-3061246cc3f8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:30.700226 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-76431575-c2b2-4580-8d30-3061246cc3f8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:30.700658 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-76431575-c2b2-4580-8d30-3061246cc3f8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:30.701345 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-76431575-c2b2-4580-8d30-3061246cc3f8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:30.701825 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-76431575-c2b2-4580-8d30-3061246cc3f8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:30.702245 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-76431575-c2b2-4580-8d30-3061246cc3f8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:30.705900 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=75 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:00:30.724435 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.objects.instance [None req-76431575-c2b2-4580-8d30-3061246cc3f8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lazy-loading 'flavor' on Instance uuid 492aa42e-764b-4444-b4aa-c0ff2a4202d9 {{(pid=126852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:00:30.906084 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-76431575-c2b2-4580-8d30-3061246cc3f8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "POST /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9/action" status: 202 len: 0 microversion: 2.20 time: 0.218400 Oct 03 15:00:30.906744 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 419/872] 10.222.0.46 () {62 vars in 1319 bytes} [Mon Oct 3 15:00:30 2022] POST /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 03 15:00:30.915095 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-9b1c5fa0-1b90-45ee-9d4f-4a4d6c0e3546 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:30.915708 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-9b1c5fa0-1b90-45ee-9d4f-4a4d6c0e3546 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:30.922198 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9b1c5fa0-1b90-45ee-9d4f-4a4d6c0e3546 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:30.922701 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9b1c5fa0-1b90-45ee-9d4f-4a4d6c0e3546 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:30.923144 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9b1c5fa0-1b90-45ee-9d4f-4a4d6c0e3546 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:30.923835 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9b1c5fa0-1b90-45ee-9d4f-4a4d6c0e3546 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:30.924814 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9b1c5fa0-1b90-45ee-9d4f-4a4d6c0e3546 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:30.925241 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9b1c5fa0-1b90-45ee-9d4f-4a4d6c0e3546 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:31.051899 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-9b1c5fa0-1b90-45ee-9d4f-4a4d6c0e3546 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:31.060758 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-9b1c5fa0-1b90-45ee-9d4f-4a4d6c0e3546 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:31.062220 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-9b1c5fa0-1b90-45ee-9d4f-4a4d6c0e3546 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:31.063369 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-9b1c5fa0-1b90-45ee-9d4f-4a4d6c0e3546 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1723 microversion: 2.20 time: 0.152201 Oct 03 15:00:31.063934 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 454/873] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:00:30 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:00:32.091391 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-67e7fb24-03a0-47e4-9898-2e6a009b4b95 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:32.092126 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-67e7fb24-03a0-47e4-9898-2e6a009b4b95 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:32.099229 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-67e7fb24-03a0-47e4-9898-2e6a009b4b95 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:32.099659 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-67e7fb24-03a0-47e4-9898-2e6a009b4b95 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:32.100200 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-67e7fb24-03a0-47e4-9898-2e6a009b4b95 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:32.100897 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-67e7fb24-03a0-47e4-9898-2e6a009b4b95 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:32.101353 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-67e7fb24-03a0-47e4-9898-2e6a009b4b95 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:32.101809 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-67e7fb24-03a0-47e4-9898-2e6a009b4b95 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:32.232203 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-67e7fb24-03a0-47e4-9898-2e6a009b4b95 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:32.240756 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-67e7fb24-03a0-47e4-9898-2e6a009b4b95 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:32.242249 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-67e7fb24-03a0-47e4-9898-2e6a009b4b95 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:32.243438 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-67e7fb24-03a0-47e4-9898-2e6a009b4b95 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1723 microversion: 2.20 time: 0.156817 Oct 03 15:00:32.243994 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 420/874] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:00:32 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:00:33.269957 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-71581e82-8389-4ad7-97ea-82b7f5a0b17c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:33.270565 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-71581e82-8389-4ad7-97ea-82b7f5a0b17c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:33.273000 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_api:SELECT=27 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:00:33.278513 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-71581e82-8389-4ad7-97ea-82b7f5a0b17c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:33.278992 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-71581e82-8389-4ad7-97ea-82b7f5a0b17c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:33.279422 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-71581e82-8389-4ad7-97ea-82b7f5a0b17c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:33.280107 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-71581e82-8389-4ad7-97ea-82b7f5a0b17c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:33.280557 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-71581e82-8389-4ad7-97ea-82b7f5a0b17c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:33.281005 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-71581e82-8389-4ad7-97ea-82b7f5a0b17c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:33.407824 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-71581e82-8389-4ad7-97ea-82b7f5a0b17c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:33.415722 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-71581e82-8389-4ad7-97ea-82b7f5a0b17c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:33.417143 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-71581e82-8389-4ad7-97ea-82b7f5a0b17c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:33.418317 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-71581e82-8389-4ad7-97ea-82b7f5a0b17c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1723 microversion: 2.20 time: 0.152849 Oct 03 15:00:33.418878 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 455/875] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:00:33 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:00:34.444339 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-6025d58d-59e4-4a1b-b6fc-debe074fbe75 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:34.445048 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-6025d58d-59e4-4a1b-b6fc-debe074fbe75 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:34.451084 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6025d58d-59e4-4a1b-b6fc-debe074fbe75 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:34.451579 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6025d58d-59e4-4a1b-b6fc-debe074fbe75 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:34.452012 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6025d58d-59e4-4a1b-b6fc-debe074fbe75 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:34.452705 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6025d58d-59e4-4a1b-b6fc-debe074fbe75 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:34.453162 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6025d58d-59e4-4a1b-b6fc-debe074fbe75 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:34.453627 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6025d58d-59e4-4a1b-b6fc-debe074fbe75 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:34.596035 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-6025d58d-59e4-4a1b-b6fc-debe074fbe75 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:34.604057 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-6025d58d-59e4-4a1b-b6fc-debe074fbe75 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:34.605481 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-6025d58d-59e4-4a1b-b6fc-debe074fbe75 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:34.606648 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-6025d58d-59e4-4a1b-b6fc-debe074fbe75 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1723 microversion: 2.20 time: 0.167017 Oct 03 15:00:34.607200 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 421/876] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:00:34 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:00:35.632706 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-922a2e7b-fd00-46e7-b417-6209431b87f5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:35.633245 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-922a2e7b-fd00-46e7-b417-6209431b87f5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:35.639680 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-922a2e7b-fd00-46e7-b417-6209431b87f5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:35.640187 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-922a2e7b-fd00-46e7-b417-6209431b87f5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:35.640623 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-922a2e7b-fd00-46e7-b417-6209431b87f5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:35.641337 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-922a2e7b-fd00-46e7-b417-6209431b87f5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:35.641823 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-922a2e7b-fd00-46e7-b417-6209431b87f5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:35.642244 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-922a2e7b-fd00-46e7-b417-6209431b87f5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:35.766051 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-922a2e7b-fd00-46e7-b417-6209431b87f5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:35.774611 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-922a2e7b-fd00-46e7-b417-6209431b87f5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:35.776043 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-922a2e7b-fd00-46e7-b417-6209431b87f5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:35.777196 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-922a2e7b-fd00-46e7-b417-6209431b87f5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1723 microversion: 2.20 time: 0.148418 Oct 03 15:00:35.777790 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 456/877] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:00:35 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:00:36.802715 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-9a918bc7-3d39-4b9e-8306-5d98e89180ac tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:36.803325 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-9a918bc7-3d39-4b9e-8306-5d98e89180ac tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:36.809797 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9a918bc7-3d39-4b9e-8306-5d98e89180ac tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:36.810226 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9a918bc7-3d39-4b9e-8306-5d98e89180ac tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:36.810660 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9a918bc7-3d39-4b9e-8306-5d98e89180ac tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:36.811358 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9a918bc7-3d39-4b9e-8306-5d98e89180ac tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:36.811812 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9a918bc7-3d39-4b9e-8306-5d98e89180ac tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:36.812234 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9a918bc7-3d39-4b9e-8306-5d98e89180ac tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:36.938454 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-9a918bc7-3d39-4b9e-8306-5d98e89180ac tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:36.946366 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-9a918bc7-3d39-4b9e-8306-5d98e89180ac tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:36.947796 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-9a918bc7-3d39-4b9e-8306-5d98e89180ac tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:36.948950 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-9a918bc7-3d39-4b9e-8306-5d98e89180ac tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1723 microversion: 2.20 time: 0.150298 Oct 03 15:00:36.949525 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 422/878] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:00:36 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:00:37.975321 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-83bd6cae-7f9f-4b2c-a807-9d26d16b6b30 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:37.975931 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-83bd6cae-7f9f-4b2c-a807-9d26d16b6b30 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:37.982325 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-83bd6cae-7f9f-4b2c-a807-9d26d16b6b30 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:37.982805 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-83bd6cae-7f9f-4b2c-a807-9d26d16b6b30 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:37.983242 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-83bd6cae-7f9f-4b2c-a807-9d26d16b6b30 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:37.983927 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-83bd6cae-7f9f-4b2c-a807-9d26d16b6b30 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:37.984382 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-83bd6cae-7f9f-4b2c-a807-9d26d16b6b30 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:37.984805 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-83bd6cae-7f9f-4b2c-a807-9d26d16b6b30 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:38.112287 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-83bd6cae-7f9f-4b2c-a807-9d26d16b6b30 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:38.120253 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-83bd6cae-7f9f-4b2c-a807-9d26d16b6b30 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:38.121722 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-83bd6cae-7f9f-4b2c-a807-9d26d16b6b30 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:38.122877 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-83bd6cae-7f9f-4b2c-a807-9d26d16b6b30 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1723 microversion: 2.20 time: 0.151425 Oct 03 15:00:38.123431 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 457/879] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:00:37 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 15:00:39.149595 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-5a1df6bd-d54e-4e29-b30b-690d56440038 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:39.150209 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-5a1df6bd-d54e-4e29-b30b-690d56440038 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:39.156952 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5a1df6bd-d54e-4e29-b30b-690d56440038 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:39.157441 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5a1df6bd-d54e-4e29-b30b-690d56440038 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:39.157912 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5a1df6bd-d54e-4e29-b30b-690d56440038 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:39.159231 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5a1df6bd-d54e-4e29-b30b-690d56440038 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:39.159692 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5a1df6bd-d54e-4e29-b30b-690d56440038 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:39.160118 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5a1df6bd-d54e-4e29-b30b-690d56440038 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:39.290581 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-5a1df6bd-d54e-4e29-b30b-690d56440038 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:39.298755 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-5a1df6bd-d54e-4e29-b30b-690d56440038 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:39.300193 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-5a1df6bd-d54e-4e29-b30b-690d56440038 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:39.301357 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-5a1df6bd-d54e-4e29-b30b-690d56440038 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1723 microversion: 2.20 time: 0.155724 Oct 03 15:00:39.301958 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 423/880] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:00:39 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:00:40.326451 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-e7000be3-ace5-46d2-ac45-42a4a2438049 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:40.327063 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-e7000be3-ace5-46d2-ac45-42a4a2438049 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:40.334720 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e7000be3-ace5-46d2-ac45-42a4a2438049 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:40.335206 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e7000be3-ace5-46d2-ac45-42a4a2438049 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:40.335639 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e7000be3-ace5-46d2-ac45-42a4a2438049 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:40.336335 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e7000be3-ace5-46d2-ac45-42a4a2438049 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:40.336791 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e7000be3-ace5-46d2-ac45-42a4a2438049 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:40.337214 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e7000be3-ace5-46d2-ac45-42a4a2438049 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:40.461514 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-e7000be3-ace5-46d2-ac45-42a4a2438049 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:40.469463 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-e7000be3-ace5-46d2-ac45-42a4a2438049 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:40.470933 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-e7000be3-ace5-46d2-ac45-42a4a2438049 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:40.472085 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-e7000be3-ace5-46d2-ac45-42a4a2438049 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1723 microversion: 2.20 time: 0.149687 Oct 03 15:00:40.472643 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 458/881] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:00:40 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:00:41.497837 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-f4bf41b8-92d4-4d62-903f-03154ed45b9e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:41.498448 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-f4bf41b8-92d4-4d62-903f-03154ed45b9e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:41.500964 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_api:SELECT=26 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:00:41.507085 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f4bf41b8-92d4-4d62-903f-03154ed45b9e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:41.507573 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f4bf41b8-92d4-4d62-903f-03154ed45b9e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:41.508007 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f4bf41b8-92d4-4d62-903f-03154ed45b9e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:41.508691 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f4bf41b8-92d4-4d62-903f-03154ed45b9e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:41.509142 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f4bf41b8-92d4-4d62-903f-03154ed45b9e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:41.509602 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f4bf41b8-92d4-4d62-903f-03154ed45b9e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:41.636488 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-f4bf41b8-92d4-4d62-903f-03154ed45b9e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:41.645109 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-f4bf41b8-92d4-4d62-903f-03154ed45b9e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:41.646574 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-f4bf41b8-92d4-4d62-903f-03154ed45b9e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:41.647722 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-f4bf41b8-92d4-4d62-903f-03154ed45b9e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1723 microversion: 2.20 time: 0.153858 Oct 03 15:00:41.648294 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 424/882] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:00:41 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:00:42.672099 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-695f5e62-34d6-4811-8301-5a2b43b037fd tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:42.672697 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-695f5e62-34d6-4811-8301-5a2b43b037fd tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:42.679143 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-695f5e62-34d6-4811-8301-5a2b43b037fd tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:42.679619 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-695f5e62-34d6-4811-8301-5a2b43b037fd tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:42.680048 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-695f5e62-34d6-4811-8301-5a2b43b037fd tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:42.680725 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-695f5e62-34d6-4811-8301-5a2b43b037fd tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:42.681173 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-695f5e62-34d6-4811-8301-5a2b43b037fd tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:42.681619 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-695f5e62-34d6-4811-8301-5a2b43b037fd tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:42.804936 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-695f5e62-34d6-4811-8301-5a2b43b037fd tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:42.812905 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-695f5e62-34d6-4811-8301-5a2b43b037fd tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:42.814388 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-695f5e62-34d6-4811-8301-5a2b43b037fd tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:42.815542 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-695f5e62-34d6-4811-8301-5a2b43b037fd tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1723 microversion: 2.20 time: 0.147283 Oct 03 15:00:42.816094 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 459/883] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:00:42 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:00:43.841390 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-9dcee898-a92a-4def-85ad-f1be35155bc7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:43.842025 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-9dcee898-a92a-4def-85ad-f1be35155bc7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:43.848398 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9dcee898-a92a-4def-85ad-f1be35155bc7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:43.848878 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9dcee898-a92a-4def-85ad-f1be35155bc7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:43.849306 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9dcee898-a92a-4def-85ad-f1be35155bc7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:43.850016 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9dcee898-a92a-4def-85ad-f1be35155bc7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:43.850472 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9dcee898-a92a-4def-85ad-f1be35155bc7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:43.850891 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9dcee898-a92a-4def-85ad-f1be35155bc7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:43.977396 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-9dcee898-a92a-4def-85ad-f1be35155bc7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:43.985306 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-9dcee898-a92a-4def-85ad-f1be35155bc7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:43.986752 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-9dcee898-a92a-4def-85ad-f1be35155bc7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:43.987902 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-9dcee898-a92a-4def-85ad-f1be35155bc7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1723 microversion: 2.20 time: 0.150387 Oct 03 15:00:43.988456 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 425/884] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:00:43 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:00:45.013638 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-4407d7f9-8d87-4929-94ab-6d1fc51afc8e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:45.014217 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-4407d7f9-8d87-4929-94ab-6d1fc51afc8e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:45.021261 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4407d7f9-8d87-4929-94ab-6d1fc51afc8e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:45.021775 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4407d7f9-8d87-4929-94ab-6d1fc51afc8e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:45.022214 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4407d7f9-8d87-4929-94ab-6d1fc51afc8e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:45.022908 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4407d7f9-8d87-4929-94ab-6d1fc51afc8e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:45.023373 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4407d7f9-8d87-4929-94ab-6d1fc51afc8e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:45.023804 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4407d7f9-8d87-4929-94ab-6d1fc51afc8e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:45.153651 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-4407d7f9-8d87-4929-94ab-6d1fc51afc8e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:45.162306 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-4407d7f9-8d87-4929-94ab-6d1fc51afc8e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:45.163755 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-4407d7f9-8d87-4929-94ab-6d1fc51afc8e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:45.164917 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-4407d7f9-8d87-4929-94ab-6d1fc51afc8e tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1723 microversion: 2.20 time: 0.155353 Oct 03 15:00:45.165490 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 460/885] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:00:45 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:00:46.190775 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-c97650da-2c1b-44bc-b920-8cf0290885ea tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:46.191385 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-c97650da-2c1b-44bc-b920-8cf0290885ea tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:46.197780 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c97650da-2c1b-44bc-b920-8cf0290885ea tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:46.198267 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c97650da-2c1b-44bc-b920-8cf0290885ea tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:46.198697 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c97650da-2c1b-44bc-b920-8cf0290885ea tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:46.199373 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c97650da-2c1b-44bc-b920-8cf0290885ea tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:46.199824 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c97650da-2c1b-44bc-b920-8cf0290885ea tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:46.200244 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c97650da-2c1b-44bc-b920-8cf0290885ea tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:46.332511 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-c97650da-2c1b-44bc-b920-8cf0290885ea tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:46.340531 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-c97650da-2c1b-44bc-b920-8cf0290885ea tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:46.341996 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-c97650da-2c1b-44bc-b920-8cf0290885ea tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:46.343287 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-c97650da-2c1b-44bc-b920-8cf0290885ea tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1723 microversion: 2.20 time: 0.156772 Oct 03 15:00:46.343711 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 426/886] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:00:46 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:00:46.434574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-d76b58e2-9e6f-4976-aa69-82a20a3ae4af tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-724941932", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-296655480", "security_groups": [{"name": "tempest-secgroup-smoke-2061145357"}], "block_device_mapping_v2": [{"uuid": "5e59039c-5ef7-4894-98e7-2d8df33a0582", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3cf2f742-adf1-4aae-8244-1e9578ee60b2"}]}} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:00:46.547144 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.network.neutron [None req-d76b58e2-9e6f-4976-aa69-82a20a3ae4af tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] validate_networks() for [('3cf2f742-adf1-4aae-8244-1e9578ee60b2', None, None, None, None, None)] {{(pid=126851) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:00:46.907106 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-d76b58e2-9e6f-4976-aa69-82a20a3ae4af tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Flavor limits 0:0:0 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:00:46.907554 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-d76b58e2-9e6f-4976-aa69-82a20a3ae4af tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Image limits 0:0:0 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:00:46.908026 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-d76b58e2-9e6f-4976-aa69-82a20a3ae4af tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Flavor pref 0:0:0 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:00:46.908427 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-d76b58e2-9e6f-4976-aa69-82a20a3ae4af tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Image pref 0:0:0 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:00:46.908832 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-d76b58e2-9e6f-4976-aa69-82a20a3ae4af tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:00:46.917379 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d76b58e2-9e6f-4976-aa69-82a20a3ae4af tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:46.917888 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d76b58e2-9e6f-4976-aa69-82a20a3ae4af tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:46.918314 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d76b58e2-9e6f-4976-aa69-82a20a3ae4af tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:46.919033 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d76b58e2-9e6f-4976-aa69-82a20a3ae4af tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:46.919500 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d76b58e2-9e6f-4976-aa69-82a20a3ae4af tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:46.919910 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d76b58e2-9e6f-4976-aa69-82a20a3ae4af tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:46.935958 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.quota [None req-d76b58e2-9e6f-4976-aa69-82a20a3ae4af tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Getting quotas for project a167b2ccacbc4e6d903b09d9a00650fe. Resources: {'ram', 'instances', 'cores'} {{(pid=126851) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:00:46.940305 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.quota [None req-d76b58e2-9e6f-4976-aa69-82a20a3ae4af tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Getting quotas for user 7cfae014351641d8a949775875a45958 and project a167b2ccacbc4e6d903b09d9a00650fe. Resources: {'ram', 'instances', 'cores'} {{(pid=126851) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:00:46.995191 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-d76b58e2-9e6f-4976-aa69-82a20a3ae4af tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Going to run 1 instances... {{(pid=126851) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:00:46.997365 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-d76b58e2-9e6f-4976-aa69-82a20a3ae4af tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 9de9bc00-4aed-4389-abb5-a31b43af2b7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5e59039c-5ef7-4894-98e7-2d8df33a0582',volume_size=None,volume_type=None)] {{(pid=126851) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:00:47.127473 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-d76b58e2-9e6f-4976-aa69-82a20a3ae4af tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.696511 Oct 03 15:00:47.128124 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 461/887] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 3 15:00:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:00:47.139018 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-0f8e6673-f923-4875-a67c-3bf275bacc00 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:47.139845 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-0f8e6673-f923-4875-a67c-3bf275bacc00 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 9de9bc00-4aed-4389-abb5-a31b43af2b7c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:47.193428 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-0f8e6673-f923-4875-a67c-3bf275bacc00 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:47.200767 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-0f8e6673-f923-4875-a67c-3bf275bacc00 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c" status: 200 len: 1093 microversion: 2.1 time: 0.065642 Oct 03 15:00:47.201670 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 427/888] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:47 2022] GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:47.368225 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-c41d4554-96ef-4189-8b97-03021b01f787 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:47.368850 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-c41d4554-96ef-4189-8b97-03021b01f787 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:47.374807 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c41d4554-96ef-4189-8b97-03021b01f787 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:47.375386 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c41d4554-96ef-4189-8b97-03021b01f787 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:47.375705 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c41d4554-96ef-4189-8b97-03021b01f787 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:47.377028 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c41d4554-96ef-4189-8b97-03021b01f787 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:47.377451 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c41d4554-96ef-4189-8b97-03021b01f787 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:47.377949 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c41d4554-96ef-4189-8b97-03021b01f787 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:47.511077 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-c41d4554-96ef-4189-8b97-03021b01f787 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:47.519041 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-c41d4554-96ef-4189-8b97-03021b01f787 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:47.520477 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-c41d4554-96ef-4189-8b97-03021b01f787 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:47.521646 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-c41d4554-96ef-4189-8b97-03021b01f787 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1723 microversion: 2.20 time: 0.157349 Oct 03 15:00:47.522199 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 462/889] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:00:47 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:00:48.223377 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-ef46b4e0-2f74-4ea4-b993-2109d98271d7 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:48.223993 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-ef46b4e0-2f74-4ea4-b993-2109d98271d7 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 9de9bc00-4aed-4389-abb5-a31b43af2b7c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:48.233717 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ef46b4e0-2f74-4ea4-b993-2109d98271d7 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:48.234206 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ef46b4e0-2f74-4ea4-b993-2109d98271d7 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:48.234642 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ef46b4e0-2f74-4ea4-b993-2109d98271d7 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:48.235334 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ef46b4e0-2f74-4ea4-b993-2109d98271d7 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:48.235786 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ef46b4e0-2f74-4ea4-b993-2109d98271d7 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:48.236248 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ef46b4e0-2f74-4ea4-b993-2109d98271d7 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:48.296315 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-ef46b4e0-2f74-4ea4-b993-2109d98271d7 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:48.304121 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-ef46b4e0-2f74-4ea4-b993-2109d98271d7 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c" status: 200 len: 1191 microversion: 2.1 time: 0.085075 Oct 03 15:00:48.304691 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 428/890] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:48 2022] GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c => generated 1191 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:48.547404 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-bc21ad77-1f61-4829-8785-d183619a923b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:48.547993 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-bc21ad77-1f61-4829-8785-d183619a923b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:48.554887 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bc21ad77-1f61-4829-8785-d183619a923b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:48.555389 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bc21ad77-1f61-4829-8785-d183619a923b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:48.555817 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bc21ad77-1f61-4829-8785-d183619a923b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:48.556519 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bc21ad77-1f61-4829-8785-d183619a923b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:48.556981 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bc21ad77-1f61-4829-8785-d183619a923b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:48.557411 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bc21ad77-1f61-4829-8785-d183619a923b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:48.691525 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-bc21ad77-1f61-4829-8785-d183619a923b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:48.700742 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-bc21ad77-1f61-4829-8785-d183619a923b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:48.702799 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-bc21ad77-1f61-4829-8785-d183619a923b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:48.703969 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-bc21ad77-1f61-4829-8785-d183619a923b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1744 microversion: 2.20 time: 0.160543 Oct 03 15:00:48.704581 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 463/891] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:00:48 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:00:49.328159 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-a1cfa46c-544d-4cf4-81db-dd3728b12fc7 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:49.329619 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-a1cfa46c-544d-4cf4-81db-dd3728b12fc7 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 9de9bc00-4aed-4389-abb5-a31b43af2b7c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:49.337835 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a1cfa46c-544d-4cf4-81db-dd3728b12fc7 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:49.338529 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a1cfa46c-544d-4cf4-81db-dd3728b12fc7 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:49.339181 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a1cfa46c-544d-4cf4-81db-dd3728b12fc7 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:49.340070 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a1cfa46c-544d-4cf4-81db-dd3728b12fc7 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:49.341088 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a1cfa46c-544d-4cf4-81db-dd3728b12fc7 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:49.341088 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a1cfa46c-544d-4cf4-81db-dd3728b12fc7 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:49.617875 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-a1cfa46c-544d-4cf4-81db-dd3728b12fc7 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:49.628573 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-a1cfa46c-544d-4cf4-81db-dd3728b12fc7 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c" status: 200 len: 1277 microversion: 2.1 time: 0.304234 Oct 03 15:00:49.629652 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 429/892] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:49 2022] GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c => generated 1277 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:49.730749 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-2952f2d2-f166-4469-af44-049ad944f86b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:49.731413 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-2952f2d2-f166-4469-af44-049ad944f86b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:49.738424 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2952f2d2-f166-4469-af44-049ad944f86b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:49.738906 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2952f2d2-f166-4469-af44-049ad944f86b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:49.739337 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2952f2d2-f166-4469-af44-049ad944f86b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:49.740034 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2952f2d2-f166-4469-af44-049ad944f86b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:49.740490 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2952f2d2-f166-4469-af44-049ad944f86b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:49.740913 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2952f2d2-f166-4469-af44-049ad944f86b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:49.877432 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-2952f2d2-f166-4469-af44-049ad944f86b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:49.886210 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-2952f2d2-f166-4469-af44-049ad944f86b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:49.887742 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-2952f2d2-f166-4469-af44-049ad944f86b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:49.888915 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-2952f2d2-f166-4469-af44-049ad944f86b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1744 microversion: 2.20 time: 0.162505 Oct 03 15:00:49.889485 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 464/893] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:00:49 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:00:50.419384 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-14b653c9-30c9-4a55-a6a2-14fcc7962dd3 req-841901c9-3a5a-487c-8e81-add13b3afa27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9de9bc00-4aed-4389-abb5-a31b43af2b7c", "tag": "27273ac0-a63f-4605-9d1e-5673f41cc216"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:00:50.433439 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-14b653c9-30c9-4a55-a6a2-14fcc7962dd3 req-841901c9-3a5a-487c-8e81-add13b3afa27 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:50.433972 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-14b653c9-30c9-4a55-a6a2-14fcc7962dd3 req-841901c9-3a5a-487c-8e81-add13b3afa27 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:50.434408 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-14b653c9-30c9-4a55-a6a2-14fcc7962dd3 req-841901c9-3a5a-487c-8e81-add13b3afa27 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:50.446111 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-14b653c9-30c9-4a55-a6a2-14fcc7962dd3 req-841901c9-3a5a-487c-8e81-add13b3afa27 service nova] Creating event network-changed:27273ac0-a63f-4605-9d1e-5673f41cc216 for instance 9de9bc00-4aed-4389-abb5-a31b43af2b7c on hv-cinder-85987 Oct 03 15:00:50.450904 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-14b653c9-30c9-4a55-a6a2-14fcc7962dd3 req-841901c9-3a5a-487c-8e81-add13b3afa27 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035233 Oct 03 15:00:50.451543 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 430/894] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 15:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:00:50.652268 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-c53d37cf-8101-411b-a471-fc641c128f34 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:50.652812 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-c53d37cf-8101-411b-a471-fc641c128f34 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 9de9bc00-4aed-4389-abb5-a31b43af2b7c] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:50.659148 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c53d37cf-8101-411b-a471-fc641c128f34 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:50.659638 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c53d37cf-8101-411b-a471-fc641c128f34 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:50.660075 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c53d37cf-8101-411b-a471-fc641c128f34 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:50.660768 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c53d37cf-8101-411b-a471-fc641c128f34 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:50.661223 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c53d37cf-8101-411b-a471-fc641c128f34 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:50.661673 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c53d37cf-8101-411b-a471-fc641c128f34 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:50.792147 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-c53d37cf-8101-411b-a471-fc641c128f34 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:50.800422 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-c53d37cf-8101-411b-a471-fc641c128f34 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c" status: 200 len: 1265 microversion: 2.1 time: 0.152069 Oct 03 15:00:50.800986 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 465/895] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:50 2022] GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:50.916475 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-a012be30-1ca1-4871-a9d6-b05e0e7ba41d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:50.917174 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-a012be30-1ca1-4871-a9d6-b05e0e7ba41d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:50.923254 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a012be30-1ca1-4871-a9d6-b05e0e7ba41d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:50.923740 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a012be30-1ca1-4871-a9d6-b05e0e7ba41d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:50.924172 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a012be30-1ca1-4871-a9d6-b05e0e7ba41d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:50.924859 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a012be30-1ca1-4871-a9d6-b05e0e7ba41d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:50.925314 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a012be30-1ca1-4871-a9d6-b05e0e7ba41d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:50.925766 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a012be30-1ca1-4871-a9d6-b05e0e7ba41d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:51.060293 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-a012be30-1ca1-4871-a9d6-b05e0e7ba41d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:51.068616 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-a012be30-1ca1-4871-a9d6-b05e0e7ba41d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:51.070100 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-a012be30-1ca1-4871-a9d6-b05e0e7ba41d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:51.071285 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-a012be30-1ca1-4871-a9d6-b05e0e7ba41d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1744 microversion: 2.20 time: 0.159074 Oct 03 15:00:51.076667 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 431/896] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:00:50 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:00:51.164393 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-94e08ea4-f90d-461f-aec5-fbdeca557953 req-676783fe-be6b-44cb-96ce-a2b0913ab8d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "492aa42e-764b-4444-b4aa-c0ff2a4202d9", "name": "network-vif-plugged", "status": "completed", "tag": "cfdafec3-b426-4742-8d49-c455e689f120"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:00:51.174971 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-94e08ea4-f90d-461f-aec5-fbdeca557953 req-676783fe-be6b-44cb-96ce-a2b0913ab8d1 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:51.175712 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-94e08ea4-f90d-461f-aec5-fbdeca557953 req-676783fe-be6b-44cb-96ce-a2b0913ab8d1 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:51.176158 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-94e08ea4-f90d-461f-aec5-fbdeca557953 req-676783fe-be6b-44cb-96ce-a2b0913ab8d1 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:51.187348 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-94e08ea4-f90d-461f-aec5-fbdeca557953 req-676783fe-be6b-44cb-96ce-a2b0913ab8d1 service nova] Creating event network-vif-plugged:cfdafec3-b426-4742-8d49-c455e689f120 for instance 492aa42e-764b-4444-b4aa-c0ff2a4202d9 on hv-cinder-85987 Oct 03 15:00:51.192666 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-94e08ea4-f90d-461f-aec5-fbdeca557953 req-676783fe-be6b-44cb-96ce-a2b0913ab8d1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031795 Oct 03 15:00:51.193303 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 466/897] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 15:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:00:51.822533 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-7165a453-8a8a-4508-a9a7-47dfe09e508d tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:51.823066 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-7165a453-8a8a-4508-a9a7-47dfe09e508d tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 9de9bc00-4aed-4389-abb5-a31b43af2b7c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:51.829755 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7165a453-8a8a-4508-a9a7-47dfe09e508d tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:51.830235 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7165a453-8a8a-4508-a9a7-47dfe09e508d tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:51.830664 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7165a453-8a8a-4508-a9a7-47dfe09e508d tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:51.831598 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7165a453-8a8a-4508-a9a7-47dfe09e508d tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:51.832046 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7165a453-8a8a-4508-a9a7-47dfe09e508d tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:51.832467 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7165a453-8a8a-4508-a9a7-47dfe09e508d tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:51.957388 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-7165a453-8a8a-4508-a9a7-47dfe09e508d tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:51.964896 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-7165a453-8a8a-4508-a9a7-47dfe09e508d tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c" status: 200 len: 1265 microversion: 2.1 time: 0.146245 Oct 03 15:00:51.965459 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 432/898] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:51 2022] GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:00:52.098592 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-11e721d2-10b3-4e02-a53d-d5671d9eebb1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:52.099216 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-11e721d2-10b3-4e02-a53d-d5671d9eebb1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:52.105710 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-11e721d2-10b3-4e02-a53d-d5671d9eebb1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:52.106189 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-11e721d2-10b3-4e02-a53d-d5671d9eebb1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:52.106617 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-11e721d2-10b3-4e02-a53d-d5671d9eebb1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:52.107296 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-11e721d2-10b3-4e02-a53d-d5671d9eebb1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:52.107746 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-11e721d2-10b3-4e02-a53d-d5671d9eebb1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:52.108164 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-11e721d2-10b3-4e02-a53d-d5671d9eebb1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:52.232472 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-11e721d2-10b3-4e02-a53d-d5671d9eebb1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:52.240989 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-11e721d2-10b3-4e02-a53d-d5671d9eebb1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:52.242655 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-11e721d2-10b3-4e02-a53d-d5671d9eebb1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:52.243811 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-11e721d2-10b3-4e02-a53d-d5671d9eebb1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1744 microversion: 2.20 time: 0.150083 Oct 03 15:00:52.244364 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 467/899] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:00:52 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:00:52.988322 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-0c7bfb64-f32b-4768-98bb-d31ef21cc4fc tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:52.988841 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-0c7bfb64-f32b-4768-98bb-d31ef21cc4fc tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 9de9bc00-4aed-4389-abb5-a31b43af2b7c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:52.997978 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0c7bfb64-f32b-4768-98bb-d31ef21cc4fc tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:52.998730 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0c7bfb64-f32b-4768-98bb-d31ef21cc4fc tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:52.999376 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0c7bfb64-f32b-4768-98bb-d31ef21cc4fc tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:53.000397 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0c7bfb64-f32b-4768-98bb-d31ef21cc4fc tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:53.001595 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0c7bfb64-f32b-4768-98bb-d31ef21cc4fc tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:53.002231 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0c7bfb64-f32b-4768-98bb-d31ef21cc4fc tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:53.135020 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-0c7bfb64-f32b-4768-98bb-d31ef21cc4fc tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:53.143667 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-0c7bfb64-f32b-4768-98bb-d31ef21cc4fc tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c" status: 200 len: 1265 microversion: 2.1 time: 0.159405 Oct 03 15:00:53.144230 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 433/900] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:52 2022] GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:53.268220 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-60ce9101-ba2f-48da-bb38-fe7d76e17e89 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:53.268749 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-60ce9101-ba2f-48da-bb38-fe7d76e17e89 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:53.275469 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-60ce9101-ba2f-48da-bb38-fe7d76e17e89 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:53.275949 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-60ce9101-ba2f-48da-bb38-fe7d76e17e89 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:53.276383 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-60ce9101-ba2f-48da-bb38-fe7d76e17e89 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:53.277080 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-60ce9101-ba2f-48da-bb38-fe7d76e17e89 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:53.277557 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-60ce9101-ba2f-48da-bb38-fe7d76e17e89 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:53.277982 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-60ce9101-ba2f-48da-bb38-fe7d76e17e89 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:53.405387 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-60ce9101-ba2f-48da-bb38-fe7d76e17e89 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:53.413359 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-60ce9101-ba2f-48da-bb38-fe7d76e17e89 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:53.414806 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-60ce9101-ba2f-48da-bb38-fe7d76e17e89 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:53.415956 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-60ce9101-ba2f-48da-bb38-fe7d76e17e89 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1744 microversion: 2.20 time: 0.151697 Oct 03 15:00:53.416506 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 468/901] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:00:53 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:00:54.166057 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-28b608c4-b156-4864-9b97-73457d7fa804 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:54.166667 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-28b608c4-b156-4864-9b97-73457d7fa804 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 9de9bc00-4aed-4389-abb5-a31b43af2b7c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:54.173040 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-28b608c4-b156-4864-9b97-73457d7fa804 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:54.173555 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-28b608c4-b156-4864-9b97-73457d7fa804 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:54.173994 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-28b608c4-b156-4864-9b97-73457d7fa804 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:54.174687 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-28b608c4-b156-4864-9b97-73457d7fa804 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:54.175142 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-28b608c4-b156-4864-9b97-73457d7fa804 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:54.175568 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-28b608c4-b156-4864-9b97-73457d7fa804 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:54.305689 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-28b608c4-b156-4864-9b97-73457d7fa804 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:54.313887 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-28b608c4-b156-4864-9b97-73457d7fa804 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c" status: 200 len: 1265 microversion: 2.1 time: 0.151220 Oct 03 15:00:54.314454 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 434/902] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:54 2022] GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:54.442230 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-639bbe54-0b90-406e-8370-ea1ae9484edd tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:54.442860 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-639bbe54-0b90-406e-8370-ea1ae9484edd tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:54.449178 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-639bbe54-0b90-406e-8370-ea1ae9484edd tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:54.449699 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-639bbe54-0b90-406e-8370-ea1ae9484edd tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:54.450129 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-639bbe54-0b90-406e-8370-ea1ae9484edd tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:54.450810 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-639bbe54-0b90-406e-8370-ea1ae9484edd tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:54.451259 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-639bbe54-0b90-406e-8370-ea1ae9484edd tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:54.451674 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-639bbe54-0b90-406e-8370-ea1ae9484edd tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:54.576633 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-639bbe54-0b90-406e-8370-ea1ae9484edd tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:54.584933 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-639bbe54-0b90-406e-8370-ea1ae9484edd tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:54.586416 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-639bbe54-0b90-406e-8370-ea1ae9484edd tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:54.587572 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-639bbe54-0b90-406e-8370-ea1ae9484edd tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1744 microversion: 2.20 time: 0.149731 Oct 03 15:00:54.588132 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 469/903] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:00:54 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:00:55.337049 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-4ef814f2-8565-4214-9840-3b994922ac30 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:55.337691 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-4ef814f2-8565-4214-9840-3b994922ac30 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 9de9bc00-4aed-4389-abb5-a31b43af2b7c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:55.344175 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4ef814f2-8565-4214-9840-3b994922ac30 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:55.344662 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4ef814f2-8565-4214-9840-3b994922ac30 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:55.345098 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4ef814f2-8565-4214-9840-3b994922ac30 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:55.345822 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4ef814f2-8565-4214-9840-3b994922ac30 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:55.346278 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4ef814f2-8565-4214-9840-3b994922ac30 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:55.346698 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-4ef814f2-8565-4214-9840-3b994922ac30 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:55.361282 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:00:55.479034 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-4ef814f2-8565-4214-9840-3b994922ac30 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:55.487132 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-4ef814f2-8565-4214-9840-3b994922ac30 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c" status: 200 len: 1265 microversion: 2.1 time: 0.154006 Oct 03 15:00:55.487694 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 435/904] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:55 2022] GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:55.612740 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-16eb61f2-51de-460f-ae8d-b72be1529305 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:55.613274 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-16eb61f2-51de-460f-ae8d-b72be1529305 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:55.619625 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-16eb61f2-51de-460f-ae8d-b72be1529305 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:55.620109 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-16eb61f2-51de-460f-ae8d-b72be1529305 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:55.620558 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-16eb61f2-51de-460f-ae8d-b72be1529305 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:55.621228 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-16eb61f2-51de-460f-ae8d-b72be1529305 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:55.621718 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-16eb61f2-51de-460f-ae8d-b72be1529305 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:55.622144 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-16eb61f2-51de-460f-ae8d-b72be1529305 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:55.750494 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-16eb61f2-51de-460f-ae8d-b72be1529305 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:55.759109 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-16eb61f2-51de-460f-ae8d-b72be1529305 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:55.760535 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-16eb61f2-51de-460f-ae8d-b72be1529305 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:55.761711 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-16eb61f2-51de-460f-ae8d-b72be1529305 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1744 microversion: 2.20 time: 0.153382 Oct 03 15:00:55.762275 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 470/905] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:00:55 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:00:56.510496 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-bcad2060-ef46-4961-a1ed-a32b12239987 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:56.511109 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-bcad2060-ef46-4961-a1ed-a32b12239987 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 9de9bc00-4aed-4389-abb5-a31b43af2b7c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:56.518137 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bcad2060-ef46-4961-a1ed-a32b12239987 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:56.518629 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bcad2060-ef46-4961-a1ed-a32b12239987 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:56.519071 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bcad2060-ef46-4961-a1ed-a32b12239987 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:56.519764 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bcad2060-ef46-4961-a1ed-a32b12239987 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:56.520220 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bcad2060-ef46-4961-a1ed-a32b12239987 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:56.520645 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bcad2060-ef46-4961-a1ed-a32b12239987 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:56.650315 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-bcad2060-ef46-4961-a1ed-a32b12239987 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:56.658649 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-bcad2060-ef46-4961-a1ed-a32b12239987 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c" status: 200 len: 1265 microversion: 2.1 time: 0.151898 Oct 03 15:00:56.659219 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 436/906] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:56 2022] GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:56.788141 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-2421acbb-dce6-444f-8ca1-298acb3c4d5b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:56.788751 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-2421acbb-dce6-444f-8ca1-298acb3c4d5b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:56.795835 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2421acbb-dce6-444f-8ca1-298acb3c4d5b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:56.796331 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2421acbb-dce6-444f-8ca1-298acb3c4d5b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:56.796749 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2421acbb-dce6-444f-8ca1-298acb3c4d5b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:56.797485 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2421acbb-dce6-444f-8ca1-298acb3c4d5b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:56.799057 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2421acbb-dce6-444f-8ca1-298acb3c4d5b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:56.799490 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2421acbb-dce6-444f-8ca1-298acb3c4d5b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:56.814714 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=100 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:00:56.926532 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell0:SELECT=2 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:00:56.945347 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-2421acbb-dce6-444f-8ca1-298acb3c4d5b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:56.947550 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell0:SELECT=6 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:00:56.955570 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-2421acbb-dce6-444f-8ca1-298acb3c4d5b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:56.957290 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-2421acbb-dce6-444f-8ca1-298acb3c4d5b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:56.958640 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-2421acbb-dce6-444f-8ca1-298acb3c4d5b tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1739 microversion: 2.20 time: 0.174573 Oct 03 15:00:56.959198 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 471/907] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:00:56 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:00:57.684576 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-80348634-49c6-4d0d-9091-92899c6a0d80 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:57.685186 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-80348634-49c6-4d0d-9091-92899c6a0d80 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 9de9bc00-4aed-4389-abb5-a31b43af2b7c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:57.690697 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell0:SELECT=2 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:00:57.693270 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-80348634-49c6-4d0d-9091-92899c6a0d80 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:57.693988 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-80348634-49c6-4d0d-9091-92899c6a0d80 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:57.694425 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-80348634-49c6-4d0d-9091-92899c6a0d80 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:57.695197 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-80348634-49c6-4d0d-9091-92899c6a0d80 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:57.695897 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-80348634-49c6-4d0d-9091-92899c6a0d80 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:57.696646 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-80348634-49c6-4d0d-9091-92899c6a0d80 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:57.856028 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-80348634-49c6-4d0d-9091-92899c6a0d80 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:57.870376 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-80348634-49c6-4d0d-9091-92899c6a0d80 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c" status: 200 len: 1265 microversion: 2.1 time: 0.190784 Oct 03 15:00:57.873575 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 437/908] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:57 2022] GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:57.984333 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-3e2caa16-820c-431b-8f59-f937190d1ea3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:57.986073 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-3e2caa16-820c-431b-8f59-f937190d1ea3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:57.993706 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3e2caa16-820c-431b-8f59-f937190d1ea3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:57.994269 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3e2caa16-820c-431b-8f59-f937190d1ea3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:57.994718 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3e2caa16-820c-431b-8f59-f937190d1ea3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:57.995422 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3e2caa16-820c-431b-8f59-f937190d1ea3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:57.995884 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3e2caa16-820c-431b-8f59-f937190d1ea3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:57.996312 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3e2caa16-820c-431b-8f59-f937190d1ea3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:58.132465 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-3e2caa16-820c-431b-8f59-f937190d1ea3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:58.140641 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-3e2caa16-820c-431b-8f59-f937190d1ea3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:58.143003 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-3e2caa16-820c-431b-8f59-f937190d1ea3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:58.144393 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-3e2caa16-820c-431b-8f59-f937190d1ea3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1739 microversion: 2.20 time: 0.164022 Oct 03 15:00:58.145165 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 472/909] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:00:57 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:00:58.895244 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-7f2237f6-d5b3-4670-9015-eae8ba7445a3 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:58.895850 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-7f2237f6-d5b3-4670-9015-eae8ba7445a3 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 9de9bc00-4aed-4389-abb5-a31b43af2b7c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:58.902757 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7f2237f6-d5b3-4670-9015-eae8ba7445a3 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:58.903276 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7f2237f6-d5b3-4670-9015-eae8ba7445a3 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:58.903765 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7f2237f6-d5b3-4670-9015-eae8ba7445a3 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:58.904428 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7f2237f6-d5b3-4670-9015-eae8ba7445a3 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:58.905146 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7f2237f6-d5b3-4670-9015-eae8ba7445a3 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:58.905873 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7f2237f6-d5b3-4670-9015-eae8ba7445a3 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:59.073285 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-7f2237f6-d5b3-4670-9015-eae8ba7445a3 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:59.083545 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-7f2237f6-d5b3-4670-9015-eae8ba7445a3 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c" status: 200 len: 1265 microversion: 2.1 time: 0.192094 Oct 03 15:00:59.099245 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 438/910] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:58 2022] GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:59.172409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-a5f32fa4-f1bd-43f1-b642-fa4296d146fd tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:59.173910 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-a5f32fa4-f1bd-43f1-b642-fa4296d146fd tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:59.180907 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a5f32fa4-f1bd-43f1-b642-fa4296d146fd tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:59.181547 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a5f32fa4-f1bd-43f1-b642-fa4296d146fd tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:59.182084 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a5f32fa4-f1bd-43f1-b642-fa4296d146fd tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:59.183064 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a5f32fa4-f1bd-43f1-b642-fa4296d146fd tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:59.183858 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a5f32fa4-f1bd-43f1-b642-fa4296d146fd tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:59.184496 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a5f32fa4-f1bd-43f1-b642-fa4296d146fd tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:59.372419 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-a5f32fa4-f1bd-43f1-b642-fa4296d146fd tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:59.386286 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-a5f32fa4-f1bd-43f1-b642-fa4296d146fd tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:59.388091 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-a5f32fa4-f1bd-43f1-b642-fa4296d146fd tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:59.389279 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-a5f32fa4-f1bd-43f1-b642-fa4296d146fd tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1739 microversion: 2.20 time: 0.220920 Oct 03 15:00:59.402743 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 473/911] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:00:59 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1739 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:01:00.112759 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-a74e366c-c720-4581-a4a1-510f1dbc9489 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:00.113335 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-a74e366c-c720-4581-a4a1-510f1dbc9489 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 9de9bc00-4aed-4389-abb5-a31b43af2b7c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:00.120317 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a74e366c-c720-4581-a4a1-510f1dbc9489 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:00.120809 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a74e366c-c720-4581-a4a1-510f1dbc9489 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:00.121393 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a74e366c-c720-4581-a4a1-510f1dbc9489 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:00.122805 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a74e366c-c720-4581-a4a1-510f1dbc9489 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:00.123271 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a74e366c-c720-4581-a4a1-510f1dbc9489 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:00.123724 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a74e366c-c720-4581-a4a1-510f1dbc9489 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:00.278860 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-a74e366c-c720-4581-a4a1-510f1dbc9489 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:00.287563 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-a74e366c-c720-4581-a4a1-510f1dbc9489 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c" status: 200 len: 1265 microversion: 2.1 time: 0.179903 Oct 03 15:01:00.288139 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 439/912] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:00 2022] GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:00.419090 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-aab012a4-85ee-45dd-9842-352effed7865 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:00.419926 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-aab012a4-85ee-45dd-9842-352effed7865 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:00.427127 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-aab012a4-85ee-45dd-9842-352effed7865 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:00.427600 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-aab012a4-85ee-45dd-9842-352effed7865 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:00.428028 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-aab012a4-85ee-45dd-9842-352effed7865 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:00.428714 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-aab012a4-85ee-45dd-9842-352effed7865 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:00.429178 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-aab012a4-85ee-45dd-9842-352effed7865 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:00.429664 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-aab012a4-85ee-45dd-9842-352effed7865 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:00.559995 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-aab012a4-85ee-45dd-9842-352effed7865 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:00.570740 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-aab012a4-85ee-45dd-9842-352effed7865 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:00.572296 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-aab012a4-85ee-45dd-9842-352effed7865 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:00.573534 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-aab012a4-85ee-45dd-9842-352effed7865 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1739 microversion: 2.20 time: 0.158385 Oct 03 15:01:00.574089 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 474/913] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:01:00 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:01:01.313812 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-21c690d8-c55b-4327-955c-c3c6eca8a811 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:01.315041 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-21c690d8-c55b-4327-955c-c3c6eca8a811 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 9de9bc00-4aed-4389-abb5-a31b43af2b7c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:01.326639 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-451dad75-01e2-433c-82b9-a4e73f11255b req-7a4aa50c-594a-4664-8423-79ef407e94d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9de9bc00-4aed-4389-abb5-a31b43af2b7c", "name": "network-vif-plugged", "status": "completed", "tag": "27273ac0-a63f-4605-9d1e-5673f41cc216"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:01:01.332570 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-21c690d8-c55b-4327-955c-c3c6eca8a811 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:01.333071 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-21c690d8-c55b-4327-955c-c3c6eca8a811 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:01.335767 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-21c690d8-c55b-4327-955c-c3c6eca8a811 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:01.336408 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-21c690d8-c55b-4327-955c-c3c6eca8a811 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:01.336939 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-21c690d8-c55b-4327-955c-c3c6eca8a811 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:01.337369 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-21c690d8-c55b-4327-955c-c3c6eca8a811 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:01.347952 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-451dad75-01e2-433c-82b9-a4e73f11255b req-7a4aa50c-594a-4664-8423-79ef407e94d5 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:01.348434 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-451dad75-01e2-433c-82b9-a4e73f11255b req-7a4aa50c-594a-4664-8423-79ef407e94d5 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:01.349068 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-451dad75-01e2-433c-82b9-a4e73f11255b req-7a4aa50c-594a-4664-8423-79ef407e94d5 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:01.373011 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-451dad75-01e2-433c-82b9-a4e73f11255b req-7a4aa50c-594a-4664-8423-79ef407e94d5 service nova] Creating event network-vif-plugged:27273ac0-a63f-4605-9d1e-5673f41cc216 for instance 9de9bc00-4aed-4389-abb5-a31b43af2b7c on hv-cinder-85987 Oct 03 15:01:01.382199 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-451dad75-01e2-433c-82b9-a4e73f11255b req-7a4aa50c-594a-4664-8423-79ef407e94d5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058939 Oct 03 15:01:01.383244 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 475/914] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 15:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:01:01.494225 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-21c690d8-c55b-4327-955c-c3c6eca8a811 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:01.503301 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-21c690d8-c55b-4327-955c-c3c6eca8a811 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c" status: 200 len: 1265 microversion: 2.1 time: 0.193745 Oct 03 15:01:01.503891 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 440/915] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:01 2022] GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:01.603129 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-e2e7e29a-db81-48f8-a326-f45bc8d23633 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:01.603930 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-e2e7e29a-db81-48f8-a326-f45bc8d23633 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:01.610809 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e2e7e29a-db81-48f8-a326-f45bc8d23633 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:01.611296 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e2e7e29a-db81-48f8-a326-f45bc8d23633 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:01.611731 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e2e7e29a-db81-48f8-a326-f45bc8d23633 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:01.613180 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e2e7e29a-db81-48f8-a326-f45bc8d23633 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:01.613862 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e2e7e29a-db81-48f8-a326-f45bc8d23633 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:01.614295 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e2e7e29a-db81-48f8-a326-f45bc8d23633 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:01.792675 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-e2e7e29a-db81-48f8-a326-f45bc8d23633 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:01.801421 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-e2e7e29a-db81-48f8-a326-f45bc8d23633 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:01.802940 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-e2e7e29a-db81-48f8-a326-f45bc8d23633 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:01.804355 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-e2e7e29a-db81-48f8-a326-f45bc8d23633 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1739 microversion: 2.20 time: 0.207846 Oct 03 15:01:01.804940 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 476/916] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:01:01 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:01:02.528643 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-ef08dbba-b94f-4e3a-b253-c3060275cd08 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:02.529735 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-ef08dbba-b94f-4e3a-b253-c3060275cd08 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 9de9bc00-4aed-4389-abb5-a31b43af2b7c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:02.539364 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ef08dbba-b94f-4e3a-b253-c3060275cd08 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:02.539857 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ef08dbba-b94f-4e3a-b253-c3060275cd08 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:02.540289 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ef08dbba-b94f-4e3a-b253-c3060275cd08 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:02.541033 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ef08dbba-b94f-4e3a-b253-c3060275cd08 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:02.541488 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ef08dbba-b94f-4e3a-b253-c3060275cd08 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:02.541942 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ef08dbba-b94f-4e3a-b253-c3060275cd08 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:02.832368 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-a90ee7ed-8f2a-4533-9051-72718faa37c7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:02.833298 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-a90ee7ed-8f2a-4533-9051-72718faa37c7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:02.841786 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-ef08dbba-b94f-4e3a-b253-c3060275cd08 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:02.848072 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a90ee7ed-8f2a-4533-9051-72718faa37c7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:02.848797 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a90ee7ed-8f2a-4533-9051-72718faa37c7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:02.849414 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a90ee7ed-8f2a-4533-9051-72718faa37c7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:02.850158 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a90ee7ed-8f2a-4533-9051-72718faa37c7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:02.850803 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a90ee7ed-8f2a-4533-9051-72718faa37c7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:02.851229 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a90ee7ed-8f2a-4533-9051-72718faa37c7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:02.854112 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-ef08dbba-b94f-4e3a-b253-c3060275cd08 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c" status: 200 len: 1265 microversion: 2.1 time: 0.330699 Oct 03 15:01:02.859027 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 441/917] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:02 2022] GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c => generated 1265 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:02.992030 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-a90ee7ed-8f2a-4533-9051-72718faa37c7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:03.000662 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-a90ee7ed-8f2a-4533-9051-72718faa37c7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:03.002150 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-a90ee7ed-8f2a-4533-9051-72718faa37c7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:03.003663 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-a90ee7ed-8f2a-4533-9051-72718faa37c7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1739 microversion: 2.20 time: 0.175492 Oct 03 15:01:03.004229 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 477/918] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:01:02 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:01:03.880957 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-c0d199c5-fcb1-4002-ae91-f175c5fdee5a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:03.882269 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-c0d199c5-fcb1-4002-ae91-f175c5fdee5a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 9de9bc00-4aed-4389-abb5-a31b43af2b7c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:03.889464 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c0d199c5-fcb1-4002-ae91-f175c5fdee5a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:03.889981 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c0d199c5-fcb1-4002-ae91-f175c5fdee5a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:03.890594 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c0d199c5-fcb1-4002-ae91-f175c5fdee5a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:03.892007 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c0d199c5-fcb1-4002-ae91-f175c5fdee5a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:03.892643 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c0d199c5-fcb1-4002-ae91-f175c5fdee5a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:03.893069 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c0d199c5-fcb1-4002-ae91-f175c5fdee5a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:04.033454 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-6ced1d5e-82e2-4207-9608-f818fcba1f99 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:04.034085 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-6ced1d5e-82e2-4207-9608-f818fcba1f99 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:04.043776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:01:04.045194 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6ced1d5e-82e2-4207-9608-f818fcba1f99 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:04.049425 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-c0d199c5-fcb1-4002-ae91-f175c5fdee5a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:04.050031 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6ced1d5e-82e2-4207-9608-f818fcba1f99 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:04.050649 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6ced1d5e-82e2-4207-9608-f818fcba1f99 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:04.051515 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6ced1d5e-82e2-4207-9608-f818fcba1f99 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:04.053138 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6ced1d5e-82e2-4207-9608-f818fcba1f99 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:04.053389 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6ced1d5e-82e2-4207-9608-f818fcba1f99 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:04.060075 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-c0d199c5-fcb1-4002-ae91-f175c5fdee5a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c" status: 200 len: 1265 microversion: 2.1 time: 0.182702 Oct 03 15:01:04.063529 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 442/919] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:03 2022] GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:04.210786 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-6ced1d5e-82e2-4207-9608-f818fcba1f99 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:04.219046 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-6ced1d5e-82e2-4207-9608-f818fcba1f99 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:04.220474 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-6ced1d5e-82e2-4207-9608-f818fcba1f99 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:04.221682 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-6ced1d5e-82e2-4207-9608-f818fcba1f99 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1739 microversion: 2.20 time: 0.193919 Oct 03 15:01:04.222245 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 478/920] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:01:04 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1739 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 15:01:05.084129 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-1b7704ea-ec11-47b4-b3d4-3b51fce86d9f tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:05.084747 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-1b7704ea-ec11-47b4-b3d4-3b51fce86d9f tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 9de9bc00-4aed-4389-abb5-a31b43af2b7c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:05.091212 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1b7704ea-ec11-47b4-b3d4-3b51fce86d9f tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:05.091713 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1b7704ea-ec11-47b4-b3d4-3b51fce86d9f tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:05.092154 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1b7704ea-ec11-47b4-b3d4-3b51fce86d9f tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:05.092852 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1b7704ea-ec11-47b4-b3d4-3b51fce86d9f tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:05.093312 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1b7704ea-ec11-47b4-b3d4-3b51fce86d9f tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:05.093767 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1b7704ea-ec11-47b4-b3d4-3b51fce86d9f tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:05.230588 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-1b7704ea-ec11-47b4-b3d4-3b51fce86d9f tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:05.239045 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-1b7704ea-ec11-47b4-b3d4-3b51fce86d9f tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c" status: 200 len: 1453 microversion: 2.1 time: 0.159019 Oct 03 15:01:05.239967 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 443/921] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:05 2022] GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:05.247980 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-6ea967d2-e1b0-4bce-ab8e-e94e59526497 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:05.248592 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-6ea967d2-e1b0-4bce-ab8e-e94e59526497 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:05.256199 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6ea967d2-e1b0-4bce-ab8e-e94e59526497 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:05.257076 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6ea967d2-e1b0-4bce-ab8e-e94e59526497 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:05.257904 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6ea967d2-e1b0-4bce-ab8e-e94e59526497 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:05.258614 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6ea967d2-e1b0-4bce-ab8e-e94e59526497 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:05.259078 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6ea967d2-e1b0-4bce-ab8e-e94e59526497 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:05.259505 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6ea967d2-e1b0-4bce-ab8e-e94e59526497 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:05.262289 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-2b84cf11-70fd-4764-9383-00aa7da54e65 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:05.263138 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-2b84cf11-70fd-4764-9383-00aa7da54e65 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 9de9bc00-4aed-4389-abb5-a31b43af2b7c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:05.270159 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2b84cf11-70fd-4764-9383-00aa7da54e65 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:05.270864 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2b84cf11-70fd-4764-9383-00aa7da54e65 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:05.271393 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2b84cf11-70fd-4764-9383-00aa7da54e65 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:05.272090 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2b84cf11-70fd-4764-9383-00aa7da54e65 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:05.272545 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2b84cf11-70fd-4764-9383-00aa7da54e65 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:05.272969 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2b84cf11-70fd-4764-9383-00aa7da54e65 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:05.424348 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-2b84cf11-70fd-4764-9383-00aa7da54e65 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:05.425223 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-6ea967d2-e1b0-4bce-ab8e-e94e59526497 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:05.432577 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-2b84cf11-70fd-4764-9383-00aa7da54e65 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c" status: 200 len: 1453 microversion: 2.1 time: 0.174541 Oct 03 15:01:05.434342 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-6ea967d2-e1b0-4bce-ab8e-e94e59526497 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:05.435770 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-6ea967d2-e1b0-4bce-ab8e-e94e59526497 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:05.437020 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-6ea967d2-e1b0-4bce-ab8e-e94e59526497 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1739 microversion: 2.20 time: 0.192950 Oct 03 15:01:05.437582 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 479/922] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:01:05 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:01:05.449835 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 444/923] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:05 2022] GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c => generated 1453 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:01:06.465923 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-8519fc8b-2de3-41ce-ae88-64f6280aa3d5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:06.466534 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-8519fc8b-2de3-41ce-ae88-64f6280aa3d5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:06.473725 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8519fc8b-2de3-41ce-ae88-64f6280aa3d5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:06.474214 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8519fc8b-2de3-41ce-ae88-64f6280aa3d5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:06.474650 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8519fc8b-2de3-41ce-ae88-64f6280aa3d5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:06.475350 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8519fc8b-2de3-41ce-ae88-64f6280aa3d5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:06.475805 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8519fc8b-2de3-41ce-ae88-64f6280aa3d5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:06.476235 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8519fc8b-2de3-41ce-ae88-64f6280aa3d5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:06.619462 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-8519fc8b-2de3-41ce-ae88-64f6280aa3d5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:06.628885 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-8519fc8b-2de3-41ce-ae88-64f6280aa3d5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:06.630570 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-8519fc8b-2de3-41ce-ae88-64f6280aa3d5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:06.631746 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-8519fc8b-2de3-41ce-ae88-64f6280aa3d5 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1739 microversion: 2.20 time: 0.170694 Oct 03 15:01:06.648051 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 480/924] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:01:06 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:01:07.430121 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-0b4981bf-64af-4627-8530-f35167aeb1a0 req-6d6aab17-63c8-4875-a645-b4a391dffd98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9de9bc00-4aed-4389-abb5-a31b43af2b7c", "tag": "27273ac0-a63f-4605-9d1e-5673f41cc216"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:01:07.440596 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-0b4981bf-64af-4627-8530-f35167aeb1a0 req-6d6aab17-63c8-4875-a645-b4a391dffd98 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:07.441155 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-0b4981bf-64af-4627-8530-f35167aeb1a0 req-6d6aab17-63c8-4875-a645-b4a391dffd98 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:07.441699 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-0b4981bf-64af-4627-8530-f35167aeb1a0 req-6d6aab17-63c8-4875-a645-b4a391dffd98 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:07.452450 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-0b4981bf-64af-4627-8530-f35167aeb1a0 req-6d6aab17-63c8-4875-a645-b4a391dffd98 service nova] Creating event network-changed:27273ac0-a63f-4605-9d1e-5673f41cc216 for instance 9de9bc00-4aed-4389-abb5-a31b43af2b7c on hv-cinder-85987 Oct 03 15:01:07.458216 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-0b4981bf-64af-4627-8530-f35167aeb1a0 req-6d6aab17-63c8-4875-a645-b4a391dffd98 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031225 Oct 03 15:01:07.458685 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 445/925] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 15:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:01:07.661014 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-7c5f31d7-1c67-4f5e-bab6-649aa7e77bfe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:07.663001 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-7c5f31d7-1c67-4f5e-bab6-649aa7e77bfe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:07.673749 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7c5f31d7-1c67-4f5e-bab6-649aa7e77bfe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:07.674589 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7c5f31d7-1c67-4f5e-bab6-649aa7e77bfe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:07.675193 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7c5f31d7-1c67-4f5e-bab6-649aa7e77bfe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:07.676878 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7c5f31d7-1c67-4f5e-bab6-649aa7e77bfe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:07.678348 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7c5f31d7-1c67-4f5e-bab6-649aa7e77bfe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:07.679141 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7c5f31d7-1c67-4f5e-bab6-649aa7e77bfe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:07.903859 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-7c5f31d7-1c67-4f5e-bab6-649aa7e77bfe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:07.916470 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-7c5f31d7-1c67-4f5e-bab6-649aa7e77bfe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:07.918628 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-7c5f31d7-1c67-4f5e-bab6-649aa7e77bfe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:07.920092 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-7c5f31d7-1c67-4f5e-bab6-649aa7e77bfe tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1739 microversion: 2.20 time: 0.264512 Oct 03 15:01:07.921104 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 481/926] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:01:07 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1739 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:01:08.946947 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-ac085237-f938-40fd-80af-13aa4d220db8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:08.951904 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-ac085237-f938-40fd-80af-13aa4d220db8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:08.958402 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ac085237-f938-40fd-80af-13aa4d220db8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:08.958889 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ac085237-f938-40fd-80af-13aa4d220db8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:08.959326 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ac085237-f938-40fd-80af-13aa4d220db8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:08.960024 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ac085237-f938-40fd-80af-13aa4d220db8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:08.960483 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ac085237-f938-40fd-80af-13aa4d220db8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:08.960912 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ac085237-f938-40fd-80af-13aa4d220db8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:09.099912 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-ac085237-f938-40fd-80af-13aa4d220db8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:09.107878 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-ac085237-f938-40fd-80af-13aa4d220db8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:09.109309 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-ac085237-f938-40fd-80af-13aa4d220db8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:09.110976 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-ac085237-f938-40fd-80af-13aa4d220db8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1721 microversion: 2.20 time: 0.168352 Oct 03 15:01:09.111537 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 446/927] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:01:08 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:01:10.137093 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-f3b465f9-ee5f-47d5-a978-e7daa2e71f1a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:10.137725 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-f3b465f9-ee5f-47d5-a978-e7daa2e71f1a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:10.144553 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f3b465f9-ee5f-47d5-a978-e7daa2e71f1a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:10.145038 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f3b465f9-ee5f-47d5-a978-e7daa2e71f1a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:10.145475 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f3b465f9-ee5f-47d5-a978-e7daa2e71f1a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:10.146277 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f3b465f9-ee5f-47d5-a978-e7daa2e71f1a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:10.146843 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f3b465f9-ee5f-47d5-a978-e7daa2e71f1a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:10.147368 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f3b465f9-ee5f-47d5-a978-e7daa2e71f1a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:10.276387 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-f3b465f9-ee5f-47d5-a978-e7daa2e71f1a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:10.284947 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-f3b465f9-ee5f-47d5-a978-e7daa2e71f1a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:10.286394 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-f3b465f9-ee5f-47d5-a978-e7daa2e71f1a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:10.287658 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-f3b465f9-ee5f-47d5-a978-e7daa2e71f1a tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1721 microversion: 2.20 time: 0.154435 Oct 03 15:01:10.288221 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 482/928] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:01:10 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:01:11.274442 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-8d8e5a74-3327-4d88-819d-c1276fbe3031 req-1dcedf2d-3141-45e2-b72c-7e2e5aea6b69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "492aa42e-764b-4444-b4aa-c0ff2a4202d9", "name": "network-vif-unplugged", "status": "completed", "tag": "cfdafec3-b426-4742-8d49-c455e689f120"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:01:11.284236 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-8d8e5a74-3327-4d88-819d-c1276fbe3031 req-1dcedf2d-3141-45e2-b72c-7e2e5aea6b69 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:11.284722 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-8d8e5a74-3327-4d88-819d-c1276fbe3031 req-1dcedf2d-3141-45e2-b72c-7e2e5aea6b69 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:11.285173 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-8d8e5a74-3327-4d88-819d-c1276fbe3031 req-1dcedf2d-3141-45e2-b72c-7e2e5aea6b69 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:11.296597 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-8d8e5a74-3327-4d88-819d-c1276fbe3031 req-1dcedf2d-3141-45e2-b72c-7e2e5aea6b69 service nova] Creating event network-vif-unplugged:cfdafec3-b426-4742-8d49-c455e689f120 for instance 492aa42e-764b-4444-b4aa-c0ff2a4202d9 on hv-cinder-85987 Oct 03 15:01:11.302093 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-8d8e5a74-3327-4d88-819d-c1276fbe3031 req-1dcedf2d-3141-45e2-b72c-7e2e5aea6b69 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031317 Oct 03 15:01:11.302677 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 447/929] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 15:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:01:11.314756 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-e9b44a12-025a-4f0a-9aa0-7ee7f83a68d8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:11.315575 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-e9b44a12-025a-4f0a-9aa0-7ee7f83a68d8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:11.321713 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e9b44a12-025a-4f0a-9aa0-7ee7f83a68d8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:11.322200 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e9b44a12-025a-4f0a-9aa0-7ee7f83a68d8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:11.322639 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e9b44a12-025a-4f0a-9aa0-7ee7f83a68d8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:11.323367 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e9b44a12-025a-4f0a-9aa0-7ee7f83a68d8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:11.323822 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e9b44a12-025a-4f0a-9aa0-7ee7f83a68d8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:11.324246 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e9b44a12-025a-4f0a-9aa0-7ee7f83a68d8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:11.454785 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-e9b44a12-025a-4f0a-9aa0-7ee7f83a68d8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:11.463303 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-e9b44a12-025a-4f0a-9aa0-7ee7f83a68d8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:11.464689 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-e9b44a12-025a-4f0a-9aa0-7ee7f83a68d8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:11.465864 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-e9b44a12-025a-4f0a-9aa0-7ee7f83a68d8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1724 microversion: 2.20 time: 0.156052 Oct 03 15:01:11.466424 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 483/930] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:01:11 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:01:11.491747 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-24168454-59cf-4591-9a02-b13879890b08 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82f1d738-9527-4ba4-925c-7f19be845628"}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:01:11.495254 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-24168454-59cf-4591-9a02-b13879890b08 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:11.502267 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-24168454-59cf-4591-9a02-b13879890b08 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:11.502761 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-24168454-59cf-4591-9a02-b13879890b08 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:11.503620 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-24168454-59cf-4591-9a02-b13879890b08 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:11.504336 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-24168454-59cf-4591-9a02-b13879890b08 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:11.504800 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-24168454-59cf-4591-9a02-b13879890b08 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:11.505226 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-24168454-59cf-4591-9a02-b13879890b08 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:11.785570 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-24168454-59cf-4591-9a02-b13879890b08 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "POST /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.298219 Oct 03 15:01:11.786225 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 448/931] 10.222.0.46 () {62 vars in 1364 bytes} [Mon Oct 3 15:01:11 2022] POST /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9/os-volume_attachments => generated 188 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:01:11.909880 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-cd828ba3-5292-4ba3-ac52-6a32907cdb44 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:11.910368 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-cd828ba3-5292-4ba3-ac52-6a32907cdb44 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:11.916194 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cd828ba3-5292-4ba3-ac52-6a32907cdb44 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:11.916675 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cd828ba3-5292-4ba3-ac52-6a32907cdb44 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:11.917110 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cd828ba3-5292-4ba3-ac52-6a32907cdb44 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:11.917834 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cd828ba3-5292-4ba3-ac52-6a32907cdb44 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:11.918291 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cd828ba3-5292-4ba3-ac52-6a32907cdb44 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:11.918715 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cd828ba3-5292-4ba3-ac52-6a32907cdb44 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:12.149833 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-cd828ba3-5292-4ba3-ac52-6a32907cdb44 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "DELETE /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9/os-volume_attachments/82f1d738-9527-4ba4-925c-7f19be845628" status: 202 len: 0 microversion: 2.20 time: 0.244379 Oct 03 15:01:12.150412 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 484/932] 10.222.0.46 () {60 vars in 1457 bytes} [Mon Oct 3 15:01:11 2022] DELETE /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9/os-volume_attachments/82f1d738-9527-4ba4-925c-7f19be845628 => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:01:12.210155 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-644d67e3-d68a-41fd-b661-75a969b78079 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:01:12.210739 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-644d67e3-d68a-41fd-b661-75a969b78079 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:12.213191 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_api:SELECT=52 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:01:12.218723 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-644d67e3-d68a-41fd-b661-75a969b78079 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:12.219207 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-644d67e3-d68a-41fd-b661-75a969b78079 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:12.220249 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-644d67e3-d68a-41fd-b661-75a969b78079 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:12.220941 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-644d67e3-d68a-41fd-b661-75a969b78079 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:12.221392 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-644d67e3-d68a-41fd-b661-75a969b78079 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:12.221839 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-644d67e3-d68a-41fd-b661-75a969b78079 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:12.250360 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-644d67e3-d68a-41fd-b661-75a969b78079 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126852) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 03 15:01:12.303133 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:01:12.318978 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-644d67e3-d68a-41fd-b661-75a969b78079 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "POST /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9/action" status: 202 len: 0 microversion: 2.20 time: 0.112612 Oct 03 15:01:12.319576 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 449/933] 10.222.0.46 () {62 vars in 1319 bytes} [Mon Oct 3 15:01:12 2022] POST /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:01:12.327649 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-5770c0f8-e8f4-4bf7-afe1-ad56fc992b45 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:12.329358 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-5770c0f8-e8f4-4bf7-afe1-ad56fc992b45 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:12.335565 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5770c0f8-e8f4-4bf7-afe1-ad56fc992b45 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:12.336062 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5770c0f8-e8f4-4bf7-afe1-ad56fc992b45 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:12.336528 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5770c0f8-e8f4-4bf7-afe1-ad56fc992b45 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:12.337317 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5770c0f8-e8f4-4bf7-afe1-ad56fc992b45 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:12.337858 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5770c0f8-e8f4-4bf7-afe1-ad56fc992b45 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:12.338311 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5770c0f8-e8f4-4bf7-afe1-ad56fc992b45 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:12.769216 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-5770c0f8-e8f4-4bf7-afe1-ad56fc992b45 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:12.777318 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-5770c0f8-e8f4-4bf7-afe1-ad56fc992b45 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:12.778766 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-5770c0f8-e8f4-4bf7-afe1-ad56fc992b45 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:12.779909 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-5770c0f8-e8f4-4bf7-afe1-ad56fc992b45 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1672 microversion: 2.20 time: 0.456082 Oct 03 15:01:12.780455 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 485/934] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:01:12 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1672 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:01:13.808065 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-8b5740c2-bf11-4134-937a-0b365da9b66d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:13.808674 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-8b5740c2-bf11-4134-937a-0b365da9b66d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:13.815142 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8b5740c2-bf11-4134-937a-0b365da9b66d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:13.815623 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8b5740c2-bf11-4134-937a-0b365da9b66d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:13.816057 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8b5740c2-bf11-4134-937a-0b365da9b66d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:13.816743 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8b5740c2-bf11-4134-937a-0b365da9b66d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:13.817200 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8b5740c2-bf11-4134-937a-0b365da9b66d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:13.817653 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8b5740c2-bf11-4134-937a-0b365da9b66d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:13.976558 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-8b5740c2-bf11-4134-937a-0b365da9b66d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:13.984663 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-8b5740c2-bf11-4134-937a-0b365da9b66d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:13.986239 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-8b5740c2-bf11-4134-937a-0b365da9b66d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:13.987393 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-8b5740c2-bf11-4134-937a-0b365da9b66d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1730 microversion: 2.20 time: 0.184137 Oct 03 15:01:13.987933 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 450/935] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:01:13 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:01:15.019014 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-61c0c904-a8d0-482a-8c45-521fc2d8bab1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:15.020361 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-61c0c904-a8d0-482a-8c45-521fc2d8bab1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:15.027381 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-61c0c904-a8d0-482a-8c45-521fc2d8bab1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:15.028185 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-61c0c904-a8d0-482a-8c45-521fc2d8bab1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:15.028859 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-61c0c904-a8d0-482a-8c45-521fc2d8bab1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:15.029825 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-61c0c904-a8d0-482a-8c45-521fc2d8bab1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:15.030521 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-61c0c904-a8d0-482a-8c45-521fc2d8bab1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:15.031160 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-61c0c904-a8d0-482a-8c45-521fc2d8bab1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:15.061813 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:01:15.188668 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-61c0c904-a8d0-482a-8c45-521fc2d8bab1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:15.197243 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-61c0c904-a8d0-482a-8c45-521fc2d8bab1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:15.198710 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-61c0c904-a8d0-482a-8c45-521fc2d8bab1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:15.199886 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-61c0c904-a8d0-482a-8c45-521fc2d8bab1 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1730 microversion: 2.20 time: 0.190507 Oct 03 15:01:15.200440 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 486/936] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:01:15 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:01:16.227521 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-36f1d4a3-1dd1-4cd1-8bb0-a44aa37ca274 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:16.228466 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-36f1d4a3-1dd1-4cd1-8bb0-a44aa37ca274 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:16.235802 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-36f1d4a3-1dd1-4cd1-8bb0-a44aa37ca274 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:16.236374 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-36f1d4a3-1dd1-4cd1-8bb0-a44aa37ca274 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:16.236892 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-36f1d4a3-1dd1-4cd1-8bb0-a44aa37ca274 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:16.237714 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-36f1d4a3-1dd1-4cd1-8bb0-a44aa37ca274 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:16.238418 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-36f1d4a3-1dd1-4cd1-8bb0-a44aa37ca274 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:16.239187 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-36f1d4a3-1dd1-4cd1-8bb0-a44aa37ca274 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:16.377216 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-36f1d4a3-1dd1-4cd1-8bb0-a44aa37ca274 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:16.385467 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-36f1d4a3-1dd1-4cd1-8bb0-a44aa37ca274 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:16.386933 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-36f1d4a3-1dd1-4cd1-8bb0-a44aa37ca274 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:16.388114 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-36f1d4a3-1dd1-4cd1-8bb0-a44aa37ca274 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1730 microversion: 2.20 time: 0.164727 Oct 03 15:01:16.388871 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 451/937] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:01:16 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:01:17.413323 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-1a1854c7-d666-438f-936d-49069d4a3b16 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:17.414079 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-1a1854c7-d666-438f-936d-49069d4a3b16 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:17.420576 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1a1854c7-d666-438f-936d-49069d4a3b16 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:17.421067 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1a1854c7-d666-438f-936d-49069d4a3b16 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:17.421529 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1a1854c7-d666-438f-936d-49069d4a3b16 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:17.422748 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1a1854c7-d666-438f-936d-49069d4a3b16 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:17.423531 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1a1854c7-d666-438f-936d-49069d4a3b16 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:17.423997 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1a1854c7-d666-438f-936d-49069d4a3b16 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:17.555642 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-1a1854c7-d666-438f-936d-49069d4a3b16 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:17.564149 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-1a1854c7-d666-438f-936d-49069d4a3b16 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:17.565683 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-1a1854c7-d666-438f-936d-49069d4a3b16 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:17.566899 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-1a1854c7-d666-438f-936d-49069d4a3b16 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1730 microversion: 2.20 time: 0.157609 Oct 03 15:01:17.567470 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 487/938] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:01:17 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:01:18.592213 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-b5ecf88d-9c67-40e1-8f9c-7ec01243dba8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:18.592817 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-b5ecf88d-9c67-40e1-8f9c-7ec01243dba8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:18.599721 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b5ecf88d-9c67-40e1-8f9c-7ec01243dba8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:18.600200 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b5ecf88d-9c67-40e1-8f9c-7ec01243dba8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:18.600652 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b5ecf88d-9c67-40e1-8f9c-7ec01243dba8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:18.601322 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b5ecf88d-9c67-40e1-8f9c-7ec01243dba8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:18.601808 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b5ecf88d-9c67-40e1-8f9c-7ec01243dba8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:18.602230 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b5ecf88d-9c67-40e1-8f9c-7ec01243dba8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:18.735364 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-b5ecf88d-9c67-40e1-8f9c-7ec01243dba8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:18.743348 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-b5ecf88d-9c67-40e1-8f9c-7ec01243dba8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:18.744783 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-b5ecf88d-9c67-40e1-8f9c-7ec01243dba8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:18.745969 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-b5ecf88d-9c67-40e1-8f9c-7ec01243dba8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1730 microversion: 2.20 time: 0.157678 Oct 03 15:01:18.746520 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 452/939] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:01:18 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:01:19.772099 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-14a9e76b-196d-45cf-a365-19f36b5a4451 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:19.772797 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-14a9e76b-196d-45cf-a365-19f36b5a4451 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:19.779652 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-14a9e76b-196d-45cf-a365-19f36b5a4451 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:19.780137 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-14a9e76b-196d-45cf-a365-19f36b5a4451 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:19.780568 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-14a9e76b-196d-45cf-a365-19f36b5a4451 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:19.781272 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-14a9e76b-196d-45cf-a365-19f36b5a4451 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:19.782251 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-14a9e76b-196d-45cf-a365-19f36b5a4451 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:19.782676 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-14a9e76b-196d-45cf-a365-19f36b5a4451 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:19.911745 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-14a9e76b-196d-45cf-a365-19f36b5a4451 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:19.919855 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-14a9e76b-196d-45cf-a365-19f36b5a4451 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:19.921284 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-14a9e76b-196d-45cf-a365-19f36b5a4451 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:19.923039 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-14a9e76b-196d-45cf-a365-19f36b5a4451 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1730 microversion: 2.20 time: 0.155036 Oct 03 15:01:19.923795 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 488/940] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:01:19 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:01:20.948365 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-8e162446-c370-42ae-992f-bc792fdb16fa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:20.949005 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-8e162446-c370-42ae-992f-bc792fdb16fa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:20.956223 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8e162446-c370-42ae-992f-bc792fdb16fa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:20.956705 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8e162446-c370-42ae-992f-bc792fdb16fa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:20.957138 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8e162446-c370-42ae-992f-bc792fdb16fa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:20.957858 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8e162446-c370-42ae-992f-bc792fdb16fa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:20.958410 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8e162446-c370-42ae-992f-bc792fdb16fa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:20.958838 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8e162446-c370-42ae-992f-bc792fdb16fa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:21.095400 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-8e162446-c370-42ae-992f-bc792fdb16fa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:21.103436 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-8e162446-c370-42ae-992f-bc792fdb16fa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:21.104887 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-8e162446-c370-42ae-992f-bc792fdb16fa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:21.106059 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-8e162446-c370-42ae-992f-bc792fdb16fa tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1730 microversion: 2.20 time: 0.161564 Oct 03 15:01:21.106619 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 453/941] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:01:20 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:01:22.131738 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-5ab7afb7-61c1-47a7-b50f-7b01743fbce4 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:22.132341 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-5ab7afb7-61c1-47a7-b50f-7b01743fbce4 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:22.138706 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5ab7afb7-61c1-47a7-b50f-7b01743fbce4 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:22.139185 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5ab7afb7-61c1-47a7-b50f-7b01743fbce4 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:22.139611 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5ab7afb7-61c1-47a7-b50f-7b01743fbce4 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:22.140292 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5ab7afb7-61c1-47a7-b50f-7b01743fbce4 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:22.140742 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5ab7afb7-61c1-47a7-b50f-7b01743fbce4 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:22.141165 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5ab7afb7-61c1-47a7-b50f-7b01743fbce4 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:22.290855 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-5ab7afb7-61c1-47a7-b50f-7b01743fbce4 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:22.302073 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-5ab7afb7-61c1-47a7-b50f-7b01743fbce4 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:22.303555 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-5ab7afb7-61c1-47a7-b50f-7b01743fbce4 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:22.304759 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-5ab7afb7-61c1-47a7-b50f-7b01743fbce4 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1730 microversion: 2.20 time: 0.176825 Oct 03 15:01:22.305541 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 489/942] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:01:22 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 15:01:23.331093 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-3cf4c3a5-0d00-426e-b576-6f66ead8b6d7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:23.331717 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-3cf4c3a5-0d00-426e-b576-6f66ead8b6d7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:23.338265 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3cf4c3a5-0d00-426e-b576-6f66ead8b6d7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:23.338581 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3cf4c3a5-0d00-426e-b576-6f66ead8b6d7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:23.339014 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3cf4c3a5-0d00-426e-b576-6f66ead8b6d7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:23.339706 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3cf4c3a5-0d00-426e-b576-6f66ead8b6d7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:23.340152 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3cf4c3a5-0d00-426e-b576-6f66ead8b6d7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:23.340568 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3cf4c3a5-0d00-426e-b576-6f66ead8b6d7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:23.492293 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-3cf4c3a5-0d00-426e-b576-6f66ead8b6d7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:23.501524 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-3cf4c3a5-0d00-426e-b576-6f66ead8b6d7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:23.502999 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-3cf4c3a5-0d00-426e-b576-6f66ead8b6d7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:23.504241 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-3cf4c3a5-0d00-426e-b576-6f66ead8b6d7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1730 microversion: 2.20 time: 0.177755 Oct 03 15:01:23.504790 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 454/943] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:01:23 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:01:24.530056 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-15796715-8498-4145-8141-eebb72ec4a69 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:24.530728 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-15796715-8498-4145-8141-eebb72ec4a69 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:24.537641 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-15796715-8498-4145-8141-eebb72ec4a69 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:24.538124 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-15796715-8498-4145-8141-eebb72ec4a69 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:24.538556 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-15796715-8498-4145-8141-eebb72ec4a69 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:24.539246 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-15796715-8498-4145-8141-eebb72ec4a69 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:24.539697 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-15796715-8498-4145-8141-eebb72ec4a69 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:24.540143 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-15796715-8498-4145-8141-eebb72ec4a69 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:24.678807 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-15796715-8498-4145-8141-eebb72ec4a69 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:24.698157 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-15796715-8498-4145-8141-eebb72ec4a69 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:24.699931 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-15796715-8498-4145-8141-eebb72ec4a69 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:24.701122 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-15796715-8498-4145-8141-eebb72ec4a69 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1730 microversion: 2.20 time: 0.174941 Oct 03 15:01:24.701955 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 490/944] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:01:24 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:01:25.734233 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-ad3122cd-bbc2-4bb7-b77f-d8735576cbbc tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:25.734881 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-ad3122cd-bbc2-4bb7-b77f-d8735576cbbc tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:25.741946 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ad3122cd-bbc2-4bb7-b77f-d8735576cbbc tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:25.742678 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ad3122cd-bbc2-4bb7-b77f-d8735576cbbc tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:25.743121 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ad3122cd-bbc2-4bb7-b77f-d8735576cbbc tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:25.743824 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ad3122cd-bbc2-4bb7-b77f-d8735576cbbc tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:25.744490 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ad3122cd-bbc2-4bb7-b77f-d8735576cbbc tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:25.744917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ad3122cd-bbc2-4bb7-b77f-d8735576cbbc tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:25.897359 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-ad3122cd-bbc2-4bb7-b77f-d8735576cbbc tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:25.905306 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-ad3122cd-bbc2-4bb7-b77f-d8735576cbbc tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:25.906773 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-ad3122cd-bbc2-4bb7-b77f-d8735576cbbc tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:25.908457 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-ad3122cd-bbc2-4bb7-b77f-d8735576cbbc tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1730 microversion: 2.20 time: 0.178354 Oct 03 15:01:25.909008 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 455/945] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:01:25 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:01:26.934476 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-a3086827-cceb-428d-88f6-8b5bfbe647bc tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:26.935090 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-a3086827-cceb-428d-88f6-8b5bfbe647bc tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:26.942263 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a3086827-cceb-428d-88f6-8b5bfbe647bc tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:26.942752 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a3086827-cceb-428d-88f6-8b5bfbe647bc tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:26.943191 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a3086827-cceb-428d-88f6-8b5bfbe647bc tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:26.943880 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a3086827-cceb-428d-88f6-8b5bfbe647bc tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:26.944337 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a3086827-cceb-428d-88f6-8b5bfbe647bc tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:26.944766 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a3086827-cceb-428d-88f6-8b5bfbe647bc tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:27.072075 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-a3086827-cceb-428d-88f6-8b5bfbe647bc tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:27.079951 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-a3086827-cceb-428d-88f6-8b5bfbe647bc tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:27.081663 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-a3086827-cceb-428d-88f6-8b5bfbe647bc tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:27.082797 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-a3086827-cceb-428d-88f6-8b5bfbe647bc tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1730 microversion: 2.20 time: 0.152377 Oct 03 15:01:27.083354 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 491/946] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:01:26 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:01:28.107925 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-2d5a3fd8-2750-434a-a9fe-7b012a7b64c6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:28.108554 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-2d5a3fd8-2750-434a-a9fe-7b012a7b64c6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:28.114898 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2d5a3fd8-2750-434a-a9fe-7b012a7b64c6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:28.115373 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2d5a3fd8-2750-434a-a9fe-7b012a7b64c6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:28.115801 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2d5a3fd8-2750-434a-a9fe-7b012a7b64c6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:28.116480 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2d5a3fd8-2750-434a-a9fe-7b012a7b64c6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:28.116931 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2d5a3fd8-2750-434a-a9fe-7b012a7b64c6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:28.117348 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2d5a3fd8-2750-434a-a9fe-7b012a7b64c6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:28.245742 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-2d5a3fd8-2750-434a-a9fe-7b012a7b64c6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:28.254641 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-2d5a3fd8-2750-434a-a9fe-7b012a7b64c6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:28.256211 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-2d5a3fd8-2750-434a-a9fe-7b012a7b64c6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:28.257362 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-2d5a3fd8-2750-434a-a9fe-7b012a7b64c6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1730 microversion: 2.20 time: 0.153353 Oct 03 15:01:28.257949 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 456/947] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:01:28 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:01:29.283901 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-1d3d962b-c643-4767-bcee-f57a13048f94 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:29.284529 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-1d3d962b-c643-4767-bcee-f57a13048f94 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:29.290969 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1d3d962b-c643-4767-bcee-f57a13048f94 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:29.291443 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1d3d962b-c643-4767-bcee-f57a13048f94 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:29.291972 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1d3d962b-c643-4767-bcee-f57a13048f94 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:29.292673 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1d3d962b-c643-4767-bcee-f57a13048f94 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:29.293122 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1d3d962b-c643-4767-bcee-f57a13048f94 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:29.293560 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1d3d962b-c643-4767-bcee-f57a13048f94 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:29.418763 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-1d3d962b-c643-4767-bcee-f57a13048f94 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:29.426680 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-1d3d962b-c643-4767-bcee-f57a13048f94 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:29.428289 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-1d3d962b-c643-4767-bcee-f57a13048f94 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:29.429448 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-1d3d962b-c643-4767-bcee-f57a13048f94 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1730 microversion: 2.20 time: 0.150120 Oct 03 15:01:29.430031 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 492/948] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:01:29 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:01:30.454455 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-ee0b4a1c-e9aa-4862-9a4e-c977b940adc2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:30.455329 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-ee0b4a1c-e9aa-4862-9a4e-c977b940adc2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:30.461704 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ee0b4a1c-e9aa-4862-9a4e-c977b940adc2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:30.462181 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ee0b4a1c-e9aa-4862-9a4e-c977b940adc2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:30.462609 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ee0b4a1c-e9aa-4862-9a4e-c977b940adc2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:30.463326 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ee0b4a1c-e9aa-4862-9a4e-c977b940adc2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:30.463780 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ee0b4a1c-e9aa-4862-9a4e-c977b940adc2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:30.464197 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ee0b4a1c-e9aa-4862-9a4e-c977b940adc2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:30.589017 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-ee0b4a1c-e9aa-4862-9a4e-c977b940adc2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:30.597549 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-ee0b4a1c-e9aa-4862-9a4e-c977b940adc2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:30.598968 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-ee0b4a1c-e9aa-4862-9a4e-c977b940adc2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:30.600104 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-ee0b4a1c-e9aa-4862-9a4e-c977b940adc2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1730 microversion: 2.20 time: 0.149503 Oct 03 15:01:30.600654 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 457/949] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:01:30 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:01:31.625998 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-87f28a80-0407-49d1-9777-42bed63f96a0 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:31.626626 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-87f28a80-0407-49d1-9777-42bed63f96a0 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:31.633346 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-87f28a80-0407-49d1-9777-42bed63f96a0 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:31.633854 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-87f28a80-0407-49d1-9777-42bed63f96a0 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:31.634288 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-87f28a80-0407-49d1-9777-42bed63f96a0 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:31.634977 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-87f28a80-0407-49d1-9777-42bed63f96a0 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:31.635425 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-87f28a80-0407-49d1-9777-42bed63f96a0 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:31.635842 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-87f28a80-0407-49d1-9777-42bed63f96a0 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:31.765436 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-87f28a80-0407-49d1-9777-42bed63f96a0 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:31.773624 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-87f28a80-0407-49d1-9777-42bed63f96a0 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:31.775043 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-87f28a80-0407-49d1-9777-42bed63f96a0 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:31.776186 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-87f28a80-0407-49d1-9777-42bed63f96a0 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1730 microversion: 2.20 time: 0.154853 Oct 03 15:01:31.776744 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 493/950] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:01:31 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:01:31.988688 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-00549c5e-e096-4def-8348-1790c7ec2e11 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:31.989126 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-00549c5e-e096-4def-8348-1790c7ec2e11 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:31.991560 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-deeb2c1f-a4a4-4949-a3fa-4651b73b042e req-f0b16718-1feb-4b92-aad5-a058f3ce250e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe4e9466-74aa-4df2-8a80-8c79b26bc20e", "tag": "e321d3a6-46f2-4be4-9d86-b86c2bf327ff"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:01:32.000710 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-00549c5e-e096-4def-8348-1790c7ec2e11 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:32.001599 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-00549c5e-e096-4def-8348-1790c7ec2e11 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:32.002373 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-deeb2c1f-a4a4-4949-a3fa-4651b73b042e req-f0b16718-1feb-4b92-aad5-a058f3ce250e service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:32.002966 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-deeb2c1f-a4a4-4949-a3fa-4651b73b042e req-f0b16718-1feb-4b92-aad5-a058f3ce250e service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:32.003460 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-deeb2c1f-a4a4-4949-a3fa-4651b73b042e req-f0b16718-1feb-4b92-aad5-a058f3ce250e service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:32.004097 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-00549c5e-e096-4def-8348-1790c7ec2e11 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:32.004822 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-00549c5e-e096-4def-8348-1790c7ec2e11 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:32.005587 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-00549c5e-e096-4def-8348-1790c7ec2e11 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:32.006017 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-00549c5e-e096-4def-8348-1790c7ec2e11 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:32.014866 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-deeb2c1f-a4a4-4949-a3fa-4651b73b042e req-f0b16718-1feb-4b92-aad5-a058f3ce250e service nova] Creating event network-changed:e321d3a6-46f2-4be4-9d86-b86c2bf327ff for instance fe4e9466-74aa-4df2-8a80-8c79b26bc20e on hv-cinder-85987 Oct 03 15:01:32.020148 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-deeb2c1f-a4a4-4949-a3fa-4651b73b042e req-f0b16718-1feb-4b92-aad5-a058f3ce250e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032677 Oct 03 15:01:32.020930 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 494/951] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 15:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:01:32.032874 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-00549c5e-e096-4def-8348-1790c7ec2e11 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Going to try to terminate instance {{(pid=126852) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:01:32.110033 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-00549c5e-e096-4def-8348-1790c7ec2e11 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "DELETE /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 204 len: 0 microversion: 2.1 time: 0.125535 Oct 03 15:01:32.110623 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 458/952] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 3 15:01:31 2022] DELETE /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:01:32.119124 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-56d5117f-57c1-4202-b93f-9a399a691239 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:32.119819 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-56d5117f-57c1-4202-b93f-9a399a691239 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:32.125828 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-56d5117f-57c1-4202-b93f-9a399a691239 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:32.126318 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-56d5117f-57c1-4202-b93f-9a399a691239 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:32.126753 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-56d5117f-57c1-4202-b93f-9a399a691239 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:32.127437 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-56d5117f-57c1-4202-b93f-9a399a691239 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:32.127894 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-56d5117f-57c1-4202-b93f-9a399a691239 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:32.128317 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-56d5117f-57c1-4202-b93f-9a399a691239 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:32.261715 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-56d5117f-57c1-4202-b93f-9a399a691239 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:32.269806 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-56d5117f-57c1-4202-b93f-9a399a691239 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1565 microversion: 2.1 time: 0.154788 Oct 03 15:01:32.270378 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 495/953] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:32 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:32.803282 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-79a135d9-6e13-4579-b2e6-db12c6dbcf1c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:32.804012 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-79a135d9-6e13-4579-b2e6-db12c6dbcf1c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:32.810512 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-79a135d9-6e13-4579-b2e6-db12c6dbcf1c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:32.810963 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-79a135d9-6e13-4579-b2e6-db12c6dbcf1c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:32.811401 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-79a135d9-6e13-4579-b2e6-db12c6dbcf1c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:32.812108 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-79a135d9-6e13-4579-b2e6-db12c6dbcf1c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:32.812566 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-79a135d9-6e13-4579-b2e6-db12c6dbcf1c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:32.813569 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-79a135d9-6e13-4579-b2e6-db12c6dbcf1c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:32.950813 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-79a135d9-6e13-4579-b2e6-db12c6dbcf1c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:32.959133 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-79a135d9-6e13-4579-b2e6-db12c6dbcf1c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:32.960582 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-79a135d9-6e13-4579-b2e6-db12c6dbcf1c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:32.961759 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-79a135d9-6e13-4579-b2e6-db12c6dbcf1c tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1730 microversion: 2.20 time: 0.162906 Oct 03 15:01:32.962318 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 459/954] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:01:32 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:01:33.293854 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-7c0ad9ef-a9bf-4dbf-89dc-359065b8846c tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:33.295080 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-7c0ad9ef-a9bf-4dbf-89dc-359065b8846c tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:33.302906 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7c0ad9ef-a9bf-4dbf-89dc-359065b8846c tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:33.303410 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7c0ad9ef-a9bf-4dbf-89dc-359065b8846c tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:33.303837 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7c0ad9ef-a9bf-4dbf-89dc-359065b8846c tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:33.304526 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7c0ad9ef-a9bf-4dbf-89dc-359065b8846c tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:33.304977 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7c0ad9ef-a9bf-4dbf-89dc-359065b8846c tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:33.305398 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7c0ad9ef-a9bf-4dbf-89dc-359065b8846c tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:33.438724 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-7c0ad9ef-a9bf-4dbf-89dc-359065b8846c tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:33.447256 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-7c0ad9ef-a9bf-4dbf-89dc-359065b8846c tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1565 microversion: 2.1 time: 0.157596 Oct 03 15:01:33.448020 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 496/955] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:33 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:33.987608 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-382ee73a-5000-4259-9ee6-31d094a815c3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:33.988226 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-382ee73a-5000-4259-9ee6-31d094a815c3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:33.995293 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-382ee73a-5000-4259-9ee6-31d094a815c3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:33.995759 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-382ee73a-5000-4259-9ee6-31d094a815c3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:33.996199 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-382ee73a-5000-4259-9ee6-31d094a815c3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:33.996910 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-382ee73a-5000-4259-9ee6-31d094a815c3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:33.997448 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-382ee73a-5000-4259-9ee6-31d094a815c3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:33.997901 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-382ee73a-5000-4259-9ee6-31d094a815c3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:34.169941 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-382ee73a-5000-4259-9ee6-31d094a815c3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:34.178519 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-382ee73a-5000-4259-9ee6-31d094a815c3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:34.180516 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-382ee73a-5000-4259-9ee6-31d094a815c3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:34.181705 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-382ee73a-5000-4259-9ee6-31d094a815c3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1730 microversion: 2.20 time: 0.198778 Oct 03 15:01:34.182258 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 460/956] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:01:33 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1730 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:01:34.471870 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-faa0677b-8178-4996-aab3-602e0271e804 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:34.472617 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-faa0677b-8178-4996-aab3-602e0271e804 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:34.475075 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_api:SELECT=38 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:01:34.480345 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-faa0677b-8178-4996-aab3-602e0271e804 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:34.480839 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-faa0677b-8178-4996-aab3-602e0271e804 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:34.481314 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-faa0677b-8178-4996-aab3-602e0271e804 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:34.482047 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-faa0677b-8178-4996-aab3-602e0271e804 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:34.482512 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-faa0677b-8178-4996-aab3-602e0271e804 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:34.482945 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-faa0677b-8178-4996-aab3-602e0271e804 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:34.615425 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-faa0677b-8178-4996-aab3-602e0271e804 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:34.623235 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-faa0677b-8178-4996-aab3-602e0271e804 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1565 microversion: 2.1 time: 0.155860 Oct 03 15:01:34.623837 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 497/957] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:34 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:35.214951 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-738941b7-c237-428d-a87f-343af2b8e5d3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:35.215641 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-738941b7-c237-428d-a87f-343af2b8e5d3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:35.221996 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-738941b7-c237-428d-a87f-343af2b8e5d3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:35.222557 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-738941b7-c237-428d-a87f-343af2b8e5d3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:35.222995 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-738941b7-c237-428d-a87f-343af2b8e5d3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:35.223678 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-738941b7-c237-428d-a87f-343af2b8e5d3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:35.224128 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-738941b7-c237-428d-a87f-343af2b8e5d3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:35.224544 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-738941b7-c237-428d-a87f-343af2b8e5d3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:35.411470 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-738941b7-c237-428d-a87f-343af2b8e5d3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:35.420632 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-738941b7-c237-428d-a87f-343af2b8e5d3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:35.422813 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-738941b7-c237-428d-a87f-343af2b8e5d3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:35.424243 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-738941b7-c237-428d-a87f-343af2b8e5d3 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1730 microversion: 2.20 time: 0.213073 Oct 03 15:01:35.424967 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 461/958] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:01:35 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1730 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:01:35.458252 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-6b12012a-90b1-48a3-9682-2f486e73f10b req-094ce408-e650-4e2b-9bc2-43d6a6270e15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "492aa42e-764b-4444-b4aa-c0ff2a4202d9", "name": "network-vif-plugged", "status": "completed", "tag": "cfdafec3-b426-4742-8d49-c455e689f120"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:01:35.469481 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-6b12012a-90b1-48a3-9682-2f486e73f10b req-094ce408-e650-4e2b-9bc2-43d6a6270e15 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:35.470571 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-6b12012a-90b1-48a3-9682-2f486e73f10b req-094ce408-e650-4e2b-9bc2-43d6a6270e15 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:35.470571 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-6b12012a-90b1-48a3-9682-2f486e73f10b req-094ce408-e650-4e2b-9bc2-43d6a6270e15 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:35.485789 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-6b12012a-90b1-48a3-9682-2f486e73f10b req-094ce408-e650-4e2b-9bc2-43d6a6270e15 service nova] Creating event network-vif-plugged:cfdafec3-b426-4742-8d49-c455e689f120 for instance 492aa42e-764b-4444-b4aa-c0ff2a4202d9 on hv-cinder-85987 Oct 03 15:01:35.492546 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-6b12012a-90b1-48a3-9682-2f486e73f10b req-094ce408-e650-4e2b-9bc2-43d6a6270e15 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038466 Oct 03 15:01:35.493796 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 498/959] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 15:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:01:35.524217 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-dc9e05c7-f10a-4703-bee2-2bc87a554590 req-53f9ab22-5950-46f9-b1b9-05d227962d1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe4e9466-74aa-4df2-8a80-8c79b26bc20e", "name": "network-vif-deleted", "tag": "e321d3a6-46f2-4be4-9d86-b86c2bf327ff"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:01:35.533788 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-dc9e05c7-f10a-4703-bee2-2bc87a554590 req-53f9ab22-5950-46f9-b1b9-05d227962d1d service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:35.534270 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-dc9e05c7-f10a-4703-bee2-2bc87a554590 req-53f9ab22-5950-46f9-b1b9-05d227962d1d service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:35.534787 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-dc9e05c7-f10a-4703-bee2-2bc87a554590 req-53f9ab22-5950-46f9-b1b9-05d227962d1d service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:35.545616 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-dc9e05c7-f10a-4703-bee2-2bc87a554590 req-53f9ab22-5950-46f9-b1b9-05d227962d1d service nova] Creating event network-vif-deleted:e321d3a6-46f2-4be4-9d86-b86c2bf327ff for instance fe4e9466-74aa-4df2-8a80-8c79b26bc20e on hv-cinder-85987 Oct 03 15:01:35.550375 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-dc9e05c7-f10a-4703-bee2-2bc87a554590 req-53f9ab22-5950-46f9-b1b9-05d227962d1d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029923 Oct 03 15:01:35.550946 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 462/960] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 15:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:01:35.647531 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-1c420eac-2426-4013-9460-0c4a30d625c3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:35.648229 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-1c420eac-2426-4013-9460-0c4a30d625c3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:35.654315 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1c420eac-2426-4013-9460-0c4a30d625c3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:35.654796 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1c420eac-2426-4013-9460-0c4a30d625c3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:35.655232 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1c420eac-2426-4013-9460-0c4a30d625c3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:35.655926 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1c420eac-2426-4013-9460-0c4a30d625c3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:35.656446 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1c420eac-2426-4013-9460-0c4a30d625c3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:35.656877 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1c420eac-2426-4013-9460-0c4a30d625c3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:35.720814 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-1c420eac-2426-4013-9460-0c4a30d625c3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:35.728830 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-1c420eac-2426-4013-9460-0c4a30d625c3 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1219 microversion: 2.1 time: 0.085499 Oct 03 15:01:35.729424 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 499/961] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:35 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:36.452111 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-3a33f0e8-e245-4989-9d0a-1b48ff1797c7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:36.452798 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-3a33f0e8-e245-4989-9d0a-1b48ff1797c7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:36.459099 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3a33f0e8-e245-4989-9d0a-1b48ff1797c7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:36.459580 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3a33f0e8-e245-4989-9d0a-1b48ff1797c7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:36.460008 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3a33f0e8-e245-4989-9d0a-1b48ff1797c7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:36.460687 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3a33f0e8-e245-4989-9d0a-1b48ff1797c7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:36.461142 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3a33f0e8-e245-4989-9d0a-1b48ff1797c7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:36.461591 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3a33f0e8-e245-4989-9d0a-1b48ff1797c7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:36.589088 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-3a33f0e8-e245-4989-9d0a-1b48ff1797c7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:36.598463 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-3a33f0e8-e245-4989-9d0a-1b48ff1797c7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:36.599939 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-3a33f0e8-e245-4989-9d0a-1b48ff1797c7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:36.601134 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-3a33f0e8-e245-4989-9d0a-1b48ff1797c7 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1730 microversion: 2.20 time: 0.153836 Oct 03 15:01:36.601723 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 463/962] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:01:36 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:01:36.752405 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-0d8ae5ce-54b6-4149-aea6-bceba1325863 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:36.753002 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-0d8ae5ce-54b6-4149-aea6-bceba1325863 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:36.759596 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0d8ae5ce-54b6-4149-aea6-bceba1325863 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:36.760099 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0d8ae5ce-54b6-4149-aea6-bceba1325863 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:36.760535 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0d8ae5ce-54b6-4149-aea6-bceba1325863 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:36.761228 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0d8ae5ce-54b6-4149-aea6-bceba1325863 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:36.761722 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0d8ae5ce-54b6-4149-aea6-bceba1325863 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:36.762210 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0d8ae5ce-54b6-4149-aea6-bceba1325863 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:36.793143 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0d8ae5ce-54b6-4149-aea6-bceba1325863 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:36.793660 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0d8ae5ce-54b6-4149-aea6-bceba1325863 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:36.794100 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0d8ae5ce-54b6-4149-aea6-bceba1325863 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:36.794538 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.objects.instance [None req-0d8ae5ce-54b6-4149-aea6-bceba1325863 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lazy-loading 'fault' on Instance uuid fe4e9466-74aa-4df2-8a80-8c79b26bc20e {{(pid=126851) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:01:36.832939 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-0d8ae5ce-54b6-4149-aea6-bceba1325863 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:36.840397 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-0d8ae5ce-54b6-4149-aea6-bceba1325863 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1224 microversion: 2.1 time: 0.091893 Oct 03 15:01:36.840959 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 500/963] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:36 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:37.627406 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-dc3c4840-5417-4185-81ad-168a24d1fc16 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:37.628129 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-dc3c4840-5417-4185-81ad-168a24d1fc16 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:37.634475 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-dc3c4840-5417-4185-81ad-168a24d1fc16 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:37.634956 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-dc3c4840-5417-4185-81ad-168a24d1fc16 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:37.635384 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-dc3c4840-5417-4185-81ad-168a24d1fc16 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:37.636069 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-dc3c4840-5417-4185-81ad-168a24d1fc16 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:37.636517 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-dc3c4840-5417-4185-81ad-168a24d1fc16 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:37.636940 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-dc3c4840-5417-4185-81ad-168a24d1fc16 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:37.760970 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-dc3c4840-5417-4185-81ad-168a24d1fc16 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:37.768892 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-dc3c4840-5417-4185-81ad-168a24d1fc16 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:37.770355 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-dc3c4840-5417-4185-81ad-168a24d1fc16 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:37.771512 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-dc3c4840-5417-4185-81ad-168a24d1fc16 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1730 microversion: 2.20 time: 0.148663 Oct 03 15:01:37.772072 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 464/964] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:01:37 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:01:37.865584 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-42f25f60-2e45-403f-a466-4110b7568ab7 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:37.866206 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-42f25f60-2e45-403f-a466-4110b7568ab7 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:37.872986 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-42f25f60-2e45-403f-a466-4110b7568ab7 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:37.873478 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-42f25f60-2e45-403f-a466-4110b7568ab7 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:37.873946 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-42f25f60-2e45-403f-a466-4110b7568ab7 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:37.874649 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-42f25f60-2e45-403f-a466-4110b7568ab7 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:37.875139 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-42f25f60-2e45-403f-a466-4110b7568ab7 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:37.875567 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-42f25f60-2e45-403f-a466-4110b7568ab7 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:37.905200 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-42f25f60-2e45-403f-a466-4110b7568ab7 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:37.905726 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-42f25f60-2e45-403f-a466-4110b7568ab7 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:37.906167 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-42f25f60-2e45-403f-a466-4110b7568ab7 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:37.906609 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.objects.instance [None req-42f25f60-2e45-403f-a466-4110b7568ab7 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lazy-loading 'fault' on Instance uuid fe4e9466-74aa-4df2-8a80-8c79b26bc20e {{(pid=126851) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:01:37.946142 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-42f25f60-2e45-403f-a466-4110b7568ab7 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7725c72e89964487843bc9bd46b8e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fae62571c3c402a8fcc4afaf4268310', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:37.954433 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-42f25f60-2e45-403f-a466-4110b7568ab7 tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 200 len: 1224 microversion: 2.1 time: 0.094196 Oct 03 15:01:37.955403 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 501/965] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:37 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:38.797094 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-96da66ea-d3ff-4825-b43e-19dd2dd185d2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:38.797832 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-96da66ea-d3ff-4825-b43e-19dd2dd185d2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:38.804247 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-96da66ea-d3ff-4825-b43e-19dd2dd185d2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:38.804731 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-96da66ea-d3ff-4825-b43e-19dd2dd185d2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:38.805172 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-96da66ea-d3ff-4825-b43e-19dd2dd185d2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:38.805890 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-96da66ea-d3ff-4825-b43e-19dd2dd185d2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:38.806346 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-96da66ea-d3ff-4825-b43e-19dd2dd185d2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:38.806772 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-96da66ea-d3ff-4825-b43e-19dd2dd185d2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:38.821710 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:01:38.936326 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-96da66ea-d3ff-4825-b43e-19dd2dd185d2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:38.944933 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-96da66ea-d3ff-4825-b43e-19dd2dd185d2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:38.946406 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-96da66ea-d3ff-4825-b43e-19dd2dd185d2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:38.947578 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-96da66ea-d3ff-4825-b43e-19dd2dd185d2 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1717 microversion: 2.20 time: 0.154341 Oct 03 15:01:38.948140 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 465/966] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:01:38 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1717 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:01:38.978610 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-ba1e658a-480f-4586-a121-fd70859a14aa tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:38.979220 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-ba1e658a-480f-4586-a121-fd70859a14aa tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] [instance: fe4e9466-74aa-4df2-8a80-8c79b26bc20e] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:38.986101 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ba1e658a-480f-4586-a121-fd70859a14aa tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:38.986580 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ba1e658a-480f-4586-a121-fd70859a14aa tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:38.987023 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ba1e658a-480f-4586-a121-fd70859a14aa tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:38.987713 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ba1e658a-480f-4586-a121-fd70859a14aa tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:38.988163 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ba1e658a-480f-4586-a121-fd70859a14aa tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:38.988589 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ba1e658a-480f-4586-a121-fd70859a14aa tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:39.001953 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.wsgi [None req-ba1e658a-480f-4586-a121-fd70859a14aa tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] HTTP exception thrown: Instance fe4e9466-74aa-4df2-8a80-8c79b26bc20e could not be found. Oct 03 15:01:39.003550 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-ba1e658a-480f-4586-a121-fd70859a14aa tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Request method failure captured: Oct 03 15:01:39.003550 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: request: GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e HTTP/1.1 Oct 03 15:01:39.003550 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept: application/json Oct 03 15:01:39.003550 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept-Encoding: identity Oct 03 15:01:39.003550 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Connection: close Oct 03 15:01:39.003550 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Length: 0 Oct 03 15:01:39.003550 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Type: application/json Oct 03 15:01:39.003550 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Host: 10.222.0.46 Oct 03 15:01:39.003550 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Openstack-System-Scope: None Oct 03 15:01:39.003550 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: User-Agent: python-urllib3/1.26.12 Oct 03 15:01:39.003550 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Auth-Token: gAAAAABjOvfSLwilIEq7214YdqrCNUlGVTmRk_ye3TT3PF87Jv6fdI58K_eEgVqeNoe9JQp6ZiSoTT-DH-H_Dk3aKaXVcoPg8nat2A8wtaqKGOAE1CrUcwpHyTHTWR9ldjIBpGgHWBmw0cHPr77Ug6S2HmNIh6Qco9eY1URKVtOtSgcSXSLxzDM Oct 03 15:01:39.003550 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Id: None Oct 03 15:01:39.003550 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Name: None Oct 03 15:01:39.003550 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Identity-Status: Confirmed Oct 03 15:01:39.003550 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Is-Admin-Project: True Oct 03 15:01:39.003550 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Id: default Oct 03 15:01:39.003550 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Name: Default Oct 03 15:01:39.003550 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Id: 8fae62571c3c402a8fcc4afaf4268310 Oct 03 15:01:39.003550 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Name: tempest-TestShelveInstance-961540047 Oct 03 15:01:39.003550 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Role: member,reader Oct 03 15:01:39.003550 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Roles: member,reader Oct 03 15:01:39.005153 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8fae62571c3c402a8fcc4afaf4268310"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8fae62571c3c402a8fcc4afaf4268310"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8fae62571c3c402a8fcc4afaf4268310"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8fae62571c3c402a8fcc4afaf4268310"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 15:01:39.005153 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant: tempest-TestShelveInstance-961540047 Oct 03 15:01:39.005153 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Id: 8fae62571c3c402a8fcc4afaf4268310 Oct 03 15:01:39.005153 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Name: tempest-TestShelveInstance-961540047 Oct 03 15:01:39.005153 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User: tempest-TestShelveInstance-961540047-project Oct 03 15:01:39.005153 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Id: default Oct 03 15:01:39.005153 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Name: Default Oct 03 15:01:39.005153 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Id: 7725c72e89964487843bc9bd46b8e3d2 Oct 03 15:01:39.005153 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Name: tempest-TestShelveInstance-961540047-project Oct 03 15:01:39.005153 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: method: > Oct 03 15:01:39.005153 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: exception: Instance fe4e9466-74aa-4df2-8a80-8c79b26bc20e could not be found. Oct 03 15:01:39.005153 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: action_args: {'id': 'fe4e9466-74aa-4df2-8a80-8c79b26bc20e'} Oct 03 15:01:39.006111 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:01:39.006111 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:01:39.006111 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:01:39.006111 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:01:39.006111 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:01:39.006111 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:01:39.006111 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:01:39.006111 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:01:39.006111 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:01:39.006111 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:01:39.006111 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe4e9466-74aa-4df2-8a80-8c79b26bc20e could not be found. Oct 03 15:01:39.006111 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:01:39.006111 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:01:39.006111 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:01:39.006111 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:01:39.006111 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:01:39.006111 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:01:39.006111 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:01:39.006111 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:01:39.006111 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:01:39.007612 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:01:39.007612 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:01:39.007612 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:01:39.007612 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:01:39.007612 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:01:39.007612 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:01:39.007612 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:01:39.007612 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe4e9466-74aa-4df2-8a80-8c79b26bc20e could not be found. Oct 03 15:01:39.007612 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:01:39.007612 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:01:39.007612 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:01:39.007612 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:01:39.007612 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:01:39.007612 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:01:39.007612 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:01:39.007612 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:01:39.007612 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe4e9466-74aa-4df2-8a80-8c79b26bc20e could not be found. Oct 03 15:01:39.007612 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:01:39.009085 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-ba1e658a-480f-4586-a121-fd70859a14aa tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Returning 404 to user: Instance fe4e9466-74aa-4df2-8a80-8c79b26bc20e could not be found. {{(pid=126851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:01:39.009085 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-ba1e658a-480f-4586-a121-fd70859a14aa tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e" status: 404 len: 111 microversion: 2.1 time: 0.030180 Oct 03 15:01:39.009085 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 502/967] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:38 2022] GET /compute/v2.1/servers/fe4e9466-74aa-4df2-8a80-8c79b26bc20e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:01:39.164870 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-64543335-296d-4eaf-8557-0bc6655662df tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] Calling method '.version_select at 0x7fe0d356daf0>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:39.184903 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-64543335-296d-4eaf-8557-0bc6655662df tempest-TestShelveInstance-961540047 tempest-TestShelveInstance-961540047-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-300642761" status: 202 len: 0 microversion: 2.1 time: 0.023851 Oct 03 15:01:39.185920 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 466/968] 10.222.0.46 () {58 vars in 1251 bytes} [Mon Oct 3 15:01:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-300642761 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:01:45.995594 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-590f4e89-b158-495b-9c95-914a26d2a83a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:45.996241 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-590f4e89-b158-495b-9c95-914a26d2a83a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:46.002974 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-590f4e89-b158-495b-9c95-914a26d2a83a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:46.003469 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-590f4e89-b158-495b-9c95-914a26d2a83a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:46.003904 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-590f4e89-b158-495b-9c95-914a26d2a83a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:46.004710 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-590f4e89-b158-495b-9c95-914a26d2a83a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:46.005063 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-590f4e89-b158-495b-9c95-914a26d2a83a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:46.005484 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-590f4e89-b158-495b-9c95-914a26d2a83a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:46.010288 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=93 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:01:46.030047 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-590f4e89-b158-495b-9c95-914a26d2a83a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb/ips" status: 200 len: 146 microversion: 2.1 time: 0.038325 Oct 03 15:01:46.030617 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 503/969] 10.222.0.46 () {58 vars in 1248 bytes} [Mon Oct 3 15:01:45 2022] GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:01:47.406070 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-7c6626c2-fbd2-4485-af30-1b10e3b8bbd5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2991d155-f73a-447e-963b-7a521d45c39a"}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:01:47.408988 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-7c6626c2-fbd2-4485-af30-1b10e3b8bbd5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:47.410819 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:01:47.415977 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7c6626c2-fbd2-4485-af30-1b10e3b8bbd5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:47.416467 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7c6626c2-fbd2-4485-af30-1b10e3b8bbd5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:47.416906 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7c6626c2-fbd2-4485-af30-1b10e3b8bbd5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:47.417639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7c6626c2-fbd2-4485-af30-1b10e3b8bbd5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:47.418105 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7c6626c2-fbd2-4485-af30-1b10e3b8bbd5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:47.418533 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7c6626c2-fbd2-4485-af30-1b10e3b8bbd5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:47.696758 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-7c6626c2-fbd2-4485-af30-1b10e3b8bbd5 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "POST /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295253 Oct 03 15:01:47.701300 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 467/970] 10.222.0.46 () {60 vars in 1323 bytes} [Mon Oct 3 15:01:47 2022] POST /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:01:55.223140 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-964df4b2-ddef-4ede-ac80-96bfdf21f313 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:55.225313 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-964df4b2-ddef-4ede-ac80-96bfdf21f313 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:55.231827 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-964df4b2-ddef-4ede-ac80-96bfdf21f313 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:55.232307 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-964df4b2-ddef-4ede-ac80-96bfdf21f313 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:55.232742 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-964df4b2-ddef-4ede-ac80-96bfdf21f313 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:55.233425 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-964df4b2-ddef-4ede-ac80-96bfdf21f313 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:55.233908 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-964df4b2-ddef-4ede-ac80-96bfdf21f313 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:55.234978 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-964df4b2-ddef-4ede-ac80-96bfdf21f313 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:55.263199 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-964df4b2-ddef-4ede-ac80-96bfdf21f313 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044437 Oct 03 15:01:55.263743 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 504/971] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 3 15:01:55 2022] GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:01:55.275275 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-96a1e5e8-b517-4fa8-a0fe-366a1463fe33 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:55.275920 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-96a1e5e8-b517-4fa8-a0fe-366a1463fe33 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:55.282704 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-96a1e5e8-b517-4fa8-a0fe-366a1463fe33 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:55.283196 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-96a1e5e8-b517-4fa8-a0fe-366a1463fe33 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:55.283638 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-96a1e5e8-b517-4fa8-a0fe-366a1463fe33 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:55.284333 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-96a1e5e8-b517-4fa8-a0fe-366a1463fe33 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:55.284793 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-96a1e5e8-b517-4fa8-a0fe-366a1463fe33 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:55.285222 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-96a1e5e8-b517-4fa8-a0fe-366a1463fe33 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:55.314592 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-96a1e5e8-b517-4fa8-a0fe-366a1463fe33 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb/os-volume_attachments/2991d155-f73a-447e-963b-7a521d45c39a" status: 200 len: 194 microversion: 2.1 time: 0.044039 Oct 03 15:01:55.315174 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 468/972] 10.222.0.46 () {58 vars in 1413 bytes} [Mon Oct 3 15:01:55 2022] GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb/os-volume_attachments/2991d155-f73a-447e-963b-7a521d45c39a => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:01:56.647970 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-8efd0033-716e-4e2f-b7fc-f9061d4b5932 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9156d7a5-3526-40c0-adfb-211c5f1b653c"}} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:01:56.650310 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-8efd0033-716e-4e2f-b7fc-f9061d4b5932 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:56.657206 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8efd0033-716e-4e2f-b7fc-f9061d4b5932 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:56.657724 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8efd0033-716e-4e2f-b7fc-f9061d4b5932 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:56.658162 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8efd0033-716e-4e2f-b7fc-f9061d4b5932 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:56.658849 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8efd0033-716e-4e2f-b7fc-f9061d4b5932 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:56.659304 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8efd0033-716e-4e2f-b7fc-f9061d4b5932 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:56.659730 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8efd0033-716e-4e2f-b7fc-f9061d4b5932 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:57.175726 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-8efd0033-716e-4e2f-b7fc-f9061d4b5932 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "POST /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.531305 Oct 03 15:01:57.176323 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 505/973] 10.222.0.46 () {60 vars in 1323 bytes} [Mon Oct 3 15:01:56 2022] POST /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb/os-volume_attachments => generated 194 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:02:04.699899 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-7b4bc452-74c3-44c7-8960-411599f5d1fc tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:04.702200 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-7b4bc452-74c3-44c7-8960-411599f5d1fc tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:04.708942 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7b4bc452-74c3-44c7-8960-411599f5d1fc tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:04.709431 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7b4bc452-74c3-44c7-8960-411599f5d1fc tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:04.709906 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7b4bc452-74c3-44c7-8960-411599f5d1fc tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:04.710606 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7b4bc452-74c3-44c7-8960-411599f5d1fc tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:04.711070 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7b4bc452-74c3-44c7-8960-411599f5d1fc tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:04.711502 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7b4bc452-74c3-44c7-8960-411599f5d1fc tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:04.741524 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-7b4bc452-74c3-44c7-8960-411599f5d1fc tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045635 Oct 03 15:02:04.742096 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 469/974] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 3 15:02:04 2022] GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:02:04.883080 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-9abbad87-cbf5-426c-acb7-129db6b4015c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:04.883594 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-9abbad87-cbf5-426c-acb7-129db6b4015c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:04.885948 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_api:SELECT=22 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:02:04.891372 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9abbad87-cbf5-426c-acb7-129db6b4015c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:04.891848 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9abbad87-cbf5-426c-acb7-129db6b4015c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:04.892281 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9abbad87-cbf5-426c-acb7-129db6b4015c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:04.892964 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9abbad87-cbf5-426c-acb7-129db6b4015c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:04.893412 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9abbad87-cbf5-426c-acb7-129db6b4015c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:04.893922 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9abbad87-cbf5-426c-acb7-129db6b4015c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:04.922495 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-9abbad87-cbf5-426c-acb7-129db6b4015c tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb/os-volume_attachments/2991d155-f73a-447e-963b-7a521d45c39a" status: 200 len: 194 microversion: 2.1 time: 0.043938 Oct 03 15:02:04.923065 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 506/975] 10.222.0.46 () {58 vars in 1413 bytes} [Mon Oct 3 15:02:04 2022] GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb/os-volume_attachments/2991d155-f73a-447e-963b-7a521d45c39a => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:02:04.933161 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-f300bedb-77d1-4db6-99da-ed4134685c5e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:04.933691 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-f300bedb-77d1-4db6-99da-ed4134685c5e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:04.939548 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f300bedb-77d1-4db6-99da-ed4134685c5e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:04.940026 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f300bedb-77d1-4db6-99da-ed4134685c5e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:04.940459 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f300bedb-77d1-4db6-99da-ed4134685c5e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:04.941139 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f300bedb-77d1-4db6-99da-ed4134685c5e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:04.941626 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f300bedb-77d1-4db6-99da-ed4134685c5e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:04.942050 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f300bedb-77d1-4db6-99da-ed4134685c5e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:05.111788 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.objects.instance [None req-f300bedb-77d1-4db6-99da-ed4134685c5e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lazy-loading 'services' on Instance uuid 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb {{(pid=126852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:02:05.224964 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-f300bedb-77d1-4db6-99da-ed4134685c5e tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb/os-volume_attachments/2991d155-f73a-447e-963b-7a521d45c39a" status: 202 len: 0 microversion: 2.1 time: 0.295345 Oct 03 15:02:05.225654 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 470/976] 10.222.0.46 () {58 vars in 1416 bytes} [Mon Oct 3 15:02:04 2022] DELETE /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb/os-volume_attachments/2991d155-f73a-447e-963b-7a521d45c39a => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:02:05.956814 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-3e882ac2-331a-461e-9c06-9103ddee2782 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:05.957421 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-3e882ac2-331a-461e-9c06-9103ddee2782 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 8f9c9350-8239-4025-852c-17a10acd5f57] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:05.963531 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3e882ac2-331a-461e-9c06-9103ddee2782 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:05.964009 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3e882ac2-331a-461e-9c06-9103ddee2782 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:05.964440 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3e882ac2-331a-461e-9c06-9103ddee2782 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:05.965119 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3e882ac2-331a-461e-9c06-9103ddee2782 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:05.965599 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3e882ac2-331a-461e-9c06-9103ddee2782 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:05.966024 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3e882ac2-331a-461e-9c06-9103ddee2782 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:05.988682 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-3e882ac2-331a-461e-9c06-9103ddee2782 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57/ips" status: 200 len: 149 microversion: 2.1 time: 0.035958 Oct 03 15:02:05.989232 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 507/977] 10.222.0.46 () {58 vars in 1248 bytes} [Mon Oct 3 15:02:05 2022] GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:02:07.321783 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-ba193f12-73c7-423b-9456-54ec9611f4fc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "216f24d2-09f6-497b-b480-e6cd4690f1a3"}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:02:07.324153 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-ba193f12-73c7-423b-9456-54ec9611f4fc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 8f9c9350-8239-4025-852c-17a10acd5f57] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:07.331695 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ba193f12-73c7-423b-9456-54ec9611f4fc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:07.332180 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ba193f12-73c7-423b-9456-54ec9611f4fc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:07.332612 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ba193f12-73c7-423b-9456-54ec9611f4fc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:07.333298 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ba193f12-73c7-423b-9456-54ec9611f4fc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:07.333775 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ba193f12-73c7-423b-9456-54ec9611f4fc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:07.334207 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ba193f12-73c7-423b-9456-54ec9611f4fc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:07.413400 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-4d2b6be5-9813-487f-a253-d888f2210cd9 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:07.414066 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-4d2b6be5-9813-487f-a253-d888f2210cd9 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:07.421429 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4d2b6be5-9813-487f-a253-d888f2210cd9 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:07.422126 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4d2b6be5-9813-487f-a253-d888f2210cd9 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:07.422560 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4d2b6be5-9813-487f-a253-d888f2210cd9 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:07.423262 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4d2b6be5-9813-487f-a253-d888f2210cd9 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:07.423714 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4d2b6be5-9813-487f-a253-d888f2210cd9 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:07.424132 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4d2b6be5-9813-487f-a253-d888f2210cd9 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:07.453848 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-4d2b6be5-9813-487f-a253-d888f2210cd9 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb/os-volume_attachments/9156d7a5-3526-40c0-adfb-211c5f1b653c" status: 200 len: 194 microversion: 2.1 time: 0.044781 Oct 03 15:02:07.454846 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 508/978] 10.222.0.46 () {58 vars in 1413 bytes} [Mon Oct 3 15:02:07 2022] GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb/os-volume_attachments/9156d7a5-3526-40c0-adfb-211c5f1b653c => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:02:07.471222 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-ffeaa9d8-3758-4962-b8e1-2bb002570012 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:07.471622 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-ffeaa9d8-3758-4962-b8e1-2bb002570012 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:07.478151 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ffeaa9d8-3758-4962-b8e1-2bb002570012 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:07.478726 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ffeaa9d8-3758-4962-b8e1-2bb002570012 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:07.479441 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ffeaa9d8-3758-4962-b8e1-2bb002570012 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:07.480387 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ffeaa9d8-3758-4962-b8e1-2bb002570012 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:07.480851 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ffeaa9d8-3758-4962-b8e1-2bb002570012 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:07.481539 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ffeaa9d8-3758-4962-b8e1-2bb002570012 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:07.570907 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.objects.instance [None req-ffeaa9d8-3758-4962-b8e1-2bb002570012 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lazy-loading 'services' on Instance uuid 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb {{(pid=126851) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:02:07.636526 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-ba193f12-73c7-423b-9456-54ec9611f4fc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "POST /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318855 Oct 03 15:02:07.637456 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 471/979] 10.222.0.46 () {60 vars in 1323 bytes} [Mon Oct 3 15:02:07 2022] POST /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:02:07.653111 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-ffeaa9d8-3758-4962-b8e1-2bb002570012 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb/os-volume_attachments/9156d7a5-3526-40c0-adfb-211c5f1b653c" status: 202 len: 0 microversion: 2.1 time: 0.185850 Oct 03 15:02:07.657255 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 509/980] 10.222.0.46 () {58 vars in 1416 bytes} [Mon Oct 3 15:02:07 2022] DELETE /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb/os-volume_attachments/9156d7a5-3526-40c0-adfb-211c5f1b653c => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 15:02:15.296071 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-cc538efb-b2f2-46ae-8e3e-f0ddec0bbc0f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:15.296071 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-cc538efb-b2f2-46ae-8e3e-f0ddec0bbc0f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 8f9c9350-8239-4025-852c-17a10acd5f57] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:15.302705 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cc538efb-b2f2-46ae-8e3e-f0ddec0bbc0f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:15.303184 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cc538efb-b2f2-46ae-8e3e-f0ddec0bbc0f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:15.303617 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cc538efb-b2f2-46ae-8e3e-f0ddec0bbc0f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:15.304302 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cc538efb-b2f2-46ae-8e3e-f0ddec0bbc0f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:15.304749 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cc538efb-b2f2-46ae-8e3e-f0ddec0bbc0f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:15.305170 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cc538efb-b2f2-46ae-8e3e-f0ddec0bbc0f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:15.307695 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:02:15.385254 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.objects.instance [None req-cc538efb-b2f2-46ae-8e3e-f0ddec0bbc0f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lazy-loading 'services' on Instance uuid 8f9c9350-8239-4025-852c-17a10acd5f57 {{(pid=126852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:02:15.455622 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-cc538efb-b2f2-46ae-8e3e-f0ddec0bbc0f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57/os-volume_attachments/216f24d2-09f6-497b-b480-e6cd4690f1a3" status: 202 len: 0 microversion: 2.1 time: 0.164845 Oct 03 15:02:15.456208 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 472/981] 10.222.0.46 () {58 vars in 1416 bytes} [Mon Oct 3 15:02:15 2022] DELETE /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57/os-volume_attachments/216f24d2-09f6-497b-b480-e6cd4690f1a3 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:02:15.472775 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-c5759f00-1226-47e2-a102-3c024ed8aa07 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:15.479717 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-c5759f00-1226-47e2-a102-3c024ed8aa07 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 8f9c9350-8239-4025-852c-17a10acd5f57] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:15.488936 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c5759f00-1226-47e2-a102-3c024ed8aa07 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:15.489423 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c5759f00-1226-47e2-a102-3c024ed8aa07 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:15.489891 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c5759f00-1226-47e2-a102-3c024ed8aa07 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:15.490785 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c5759f00-1226-47e2-a102-3c024ed8aa07 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:15.491242 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c5759f00-1226-47e2-a102-3c024ed8aa07 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:15.491667 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c5759f00-1226-47e2-a102-3c024ed8aa07 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:15.522087 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-c5759f00-1226-47e2-a102-3c024ed8aa07 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061131 Oct 03 15:02:15.522649 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 510/982] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 3 15:02:15 2022] GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:02:16.241282 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-ee561604-eb7d-4237-997a-6b211a920389 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:16.243748 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-ee561604-eb7d-4237-997a-6b211a920389 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:16.249769 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ee561604-eb7d-4237-997a-6b211a920389 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:16.250251 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ee561604-eb7d-4237-997a-6b211a920389 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:16.250686 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ee561604-eb7d-4237-997a-6b211a920389 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:16.251371 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ee561604-eb7d-4237-997a-6b211a920389 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:16.251827 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ee561604-eb7d-4237-997a-6b211a920389 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:16.252253 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ee561604-eb7d-4237-997a-6b211a920389 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:16.280671 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-ee561604-eb7d-4237-997a-6b211a920389 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043958 Oct 03 15:02:16.281673 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 473/983] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 3 15:02:16 2022] GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 15:02:16.407132 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-03fd7b27-9d55-47e7-a69d-8290fd939124 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:16.409325 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-03fd7b27-9d55-47e7-a69d-8290fd939124 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:16.415155 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-03fd7b27-9d55-47e7-a69d-8290fd939124 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:16.415635 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-03fd7b27-9d55-47e7-a69d-8290fd939124 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:16.416075 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-03fd7b27-9d55-47e7-a69d-8290fd939124 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:16.416770 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-03fd7b27-9d55-47e7-a69d-8290fd939124 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:16.417228 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-03fd7b27-9d55-47e7-a69d-8290fd939124 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:16.417689 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-03fd7b27-9d55-47e7-a69d-8290fd939124 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:16.421324 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:02:16.447842 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-03fd7b27-9d55-47e7-a69d-8290fd939124 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045156 Oct 03 15:02:16.448385 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 511/984] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 3 15:02:16 2022] GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 15:02:16.516041 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-38c0fe7b-3ae9-4b35-a224-c429edb2f0ed tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:16.516576 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-38c0fe7b-3ae9-4b35-a224-c429edb2f0ed tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:16.522477 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-38c0fe7b-3ae9-4b35-a224-c429edb2f0ed tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:16.522973 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-38c0fe7b-3ae9-4b35-a224-c429edb2f0ed tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:16.523609 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-38c0fe7b-3ae9-4b35-a224-c429edb2f0ed tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:16.524302 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-38c0fe7b-3ae9-4b35-a224-c429edb2f0ed tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:16.524761 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-38c0fe7b-3ae9-4b35-a224-c429edb2f0ed tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:16.525188 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-38c0fe7b-3ae9-4b35-a224-c429edb2f0ed tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:16.535085 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-a25e6488-17bf-45d3-8023-efbf4a459ecd tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:16.537806 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-a25e6488-17bf-45d3-8023-efbf4a459ecd tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 8f9c9350-8239-4025-852c-17a10acd5f57] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:16.543832 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a25e6488-17bf-45d3-8023-efbf4a459ecd tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:16.544318 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a25e6488-17bf-45d3-8023-efbf4a459ecd tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:16.544751 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a25e6488-17bf-45d3-8023-efbf4a459ecd tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:16.545446 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a25e6488-17bf-45d3-8023-efbf4a459ecd tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:16.545931 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a25e6488-17bf-45d3-8023-efbf4a459ecd tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:16.546383 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a25e6488-17bf-45d3-8023-efbf4a459ecd tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:16.552064 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-38c0fe7b-3ae9-4b35-a224-c429edb2f0ed tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb] Going to try to terminate instance {{(pid=126852) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:02:16.574616 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-a25e6488-17bf-45d3-8023-efbf4a459ecd tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043920 Oct 03 15:02:16.575198 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 512/985] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 3 15:02:16 2022] GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 03 15:02:16.631528 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-38c0fe7b-3ae9-4b35-a224-c429edb2f0ed tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb" status: 204 len: 0 microversion: 2.1 time: 0.119651 Oct 03 15:02:16.632344 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 474/986] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 3 15:02:16 2022] DELETE /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:02:16.642474 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-a053df3f-d85d-4620-8431-ec1a9d668857 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:16.642640 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-40659389-a5b9-4581-a415-450f72618194 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:16.643039 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-40659389-a5b9-4581-a415-450f72618194 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 8f9c9350-8239-4025-852c-17a10acd5f57] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:16.643439 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-a053df3f-d85d-4620-8431-ec1a9d668857 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:16.648933 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-40659389-a5b9-4581-a415-450f72618194 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:16.649197 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a053df3f-d85d-4620-8431-ec1a9d668857 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:16.649472 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-40659389-a5b9-4581-a415-450f72618194 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:16.649725 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a053df3f-d85d-4620-8431-ec1a9d668857 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:16.649948 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-40659389-a5b9-4581-a415-450f72618194 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:16.650154 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a053df3f-d85d-4620-8431-ec1a9d668857 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:16.650642 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-40659389-a5b9-4581-a415-450f72618194 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:16.650832 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a053df3f-d85d-4620-8431-ec1a9d668857 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:16.651097 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-40659389-a5b9-4581-a415-450f72618194 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:16.651276 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a053df3f-d85d-4620-8431-ec1a9d668857 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:16.651522 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-40659389-a5b9-4581-a415-450f72618194 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:16.651689 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a053df3f-d85d-4620-8431-ec1a9d668857 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:16.679656 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-40659389-a5b9-4581-a415-450f72618194 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 8f9c9350-8239-4025-852c-17a10acd5f57] Going to try to terminate instance {{(pid=126851) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:02:16.763078 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-40659389-a5b9-4581-a415-450f72618194 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57" status: 204 len: 0 microversion: 2.1 time: 0.124996 Oct 03 15:02:16.763883 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 513/987] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 3 15:02:16 2022] DELETE /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:02:16.773151 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-662082a4-879b-4e84-8a8e-8eb1091c5d47 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:16.773891 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-662082a4-879b-4e84-8a8e-8eb1091c5d47 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 8f9c9350-8239-4025-852c-17a10acd5f57] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:16.779822 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-662082a4-879b-4e84-8a8e-8eb1091c5d47 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:16.780308 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-662082a4-879b-4e84-8a8e-8eb1091c5d47 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:16.780834 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-662082a4-879b-4e84-8a8e-8eb1091c5d47 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:16.781574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-662082a4-879b-4e84-8a8e-8eb1091c5d47 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:16.782083 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-662082a4-879b-4e84-8a8e-8eb1091c5d47 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:16.782715 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-662082a4-879b-4e84-8a8e-8eb1091c5d47 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:16.791307 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-a053df3f-d85d-4620-8431-ec1a9d668857 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:02:16.799248 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-a053df3f-d85d-4620-8431-ec1a9d668857 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb" status: 200 len: 1673 microversion: 2.1 time: 0.161244 Oct 03 15:02:16.799912 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 475/988] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:02:16 2022] GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:02:16.916055 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-662082a4-879b-4e84-8a8e-8eb1091c5d47 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:02:16.924017 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-662082a4-879b-4e84-8a8e-8eb1091c5d47 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57" status: 200 len: 1681 microversion: 2.1 time: 0.154972 Oct 03 15:02:16.924603 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 514/989] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:02:16 2022] GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:02:17.823158 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-87e64f94-e2d9-4ac6-8c7b-cf6df136a763 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:17.823804 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-87e64f94-e2d9-4ac6-8c7b-cf6df136a763 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:17.826202 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:02:17.833511 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-87e64f94-e2d9-4ac6-8c7b-cf6df136a763 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:17.834008 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-87e64f94-e2d9-4ac6-8c7b-cf6df136a763 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:17.834446 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-87e64f94-e2d9-4ac6-8c7b-cf6df136a763 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:17.835141 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-87e64f94-e2d9-4ac6-8c7b-cf6df136a763 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:17.835594 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-87e64f94-e2d9-4ac6-8c7b-cf6df136a763 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:17.836016 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-87e64f94-e2d9-4ac6-8c7b-cf6df136a763 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:17.946625 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-f3055145-ac4d-40c0-b4ac-b83ce7b836bd tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:17.947484 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-f3055145-ac4d-40c0-b4ac-b83ce7b836bd tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 8f9c9350-8239-4025-852c-17a10acd5f57] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:17.954805 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f3055145-ac4d-40c0-b4ac-b83ce7b836bd tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:17.955230 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f3055145-ac4d-40c0-b4ac-b83ce7b836bd tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:17.955660 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f3055145-ac4d-40c0-b4ac-b83ce7b836bd tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:17.956345 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f3055145-ac4d-40c0-b4ac-b83ce7b836bd tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:17.957411 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f3055145-ac4d-40c0-b4ac-b83ce7b836bd tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:17.957871 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f3055145-ac4d-40c0-b4ac-b83ce7b836bd tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:17.963587 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-87e64f94-e2d9-4ac6-8c7b-cf6df136a763 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:02:17.972176 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-87e64f94-e2d9-4ac6-8c7b-cf6df136a763 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb" status: 200 len: 1673 microversion: 2.1 time: 0.152812 Oct 03 15:02:17.973089 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 476/990] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:02:17 2022] GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:02:18.084805 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-f3055145-ac4d-40c0-b4ac-b83ce7b836bd tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:02:18.092500 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-f3055145-ac4d-40c0-b4ac-b83ce7b836bd tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57" status: 200 len: 1681 microversion: 2.1 time: 0.149706 Oct 03 15:02:18.093061 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 515/991] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:02:17 2022] GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:02:18.995830 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-920f7b81-872b-4832-8bd3-9e8a39f09b93 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:18.996434 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-920f7b81-872b-4832-8bd3-9e8a39f09b93 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:19.002833 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-920f7b81-872b-4832-8bd3-9e8a39f09b93 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:19.003321 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-920f7b81-872b-4832-8bd3-9e8a39f09b93 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:19.003763 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-920f7b81-872b-4832-8bd3-9e8a39f09b93 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:19.004457 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-920f7b81-872b-4832-8bd3-9e8a39f09b93 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:19.004924 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-920f7b81-872b-4832-8bd3-9e8a39f09b93 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:19.005352 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-920f7b81-872b-4832-8bd3-9e8a39f09b93 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:19.115989 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-23aa77c7-29a3-43d2-86a5-b5a2a44639e8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:19.116602 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-23aa77c7-29a3-43d2-86a5-b5a2a44639e8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 8f9c9350-8239-4025-852c-17a10acd5f57] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:19.123085 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-23aa77c7-29a3-43d2-86a5-b5a2a44639e8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:19.123596 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-23aa77c7-29a3-43d2-86a5-b5a2a44639e8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:19.124020 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-23aa77c7-29a3-43d2-86a5-b5a2a44639e8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:19.124715 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-23aa77c7-29a3-43d2-86a5-b5a2a44639e8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:19.125168 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-23aa77c7-29a3-43d2-86a5-b5a2a44639e8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:19.125613 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-23aa77c7-29a3-43d2-86a5-b5a2a44639e8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:19.130331 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-920f7b81-872b-4832-8bd3-9e8a39f09b93 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:02:19.137953 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-920f7b81-872b-4832-8bd3-9e8a39f09b93 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb" status: 200 len: 1673 microversion: 2.1 time: 0.145963 Oct 03 15:02:19.138716 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 477/992] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:02:18 2022] GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb => generated 1673 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:02:19.255564 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-23aa77c7-29a3-43d2-86a5-b5a2a44639e8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:02:19.263200 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-23aa77c7-29a3-43d2-86a5-b5a2a44639e8 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57" status: 200 len: 1681 microversion: 2.1 time: 0.151096 Oct 03 15:02:19.263757 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 516/993] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:02:19 2022] GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:02:20.160160 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-0f99a3ea-bc53-4467-a9dd-6267ee591be8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:20.161039 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-0f99a3ea-bc53-4467-a9dd-6267ee591be8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:20.167746 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0f99a3ea-bc53-4467-a9dd-6267ee591be8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:20.168234 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0f99a3ea-bc53-4467-a9dd-6267ee591be8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:20.168665 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0f99a3ea-bc53-4467-a9dd-6267ee591be8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:20.169358 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0f99a3ea-bc53-4467-a9dd-6267ee591be8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:20.169836 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0f99a3ea-bc53-4467-a9dd-6267ee591be8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:20.170256 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0f99a3ea-bc53-4467-a9dd-6267ee591be8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:20.286811 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-b8d08e43-0879-4b2e-8adc-b7b37f1bb6c2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:20.287422 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-b8d08e43-0879-4b2e-8adc-b7b37f1bb6c2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 8f9c9350-8239-4025-852c-17a10acd5f57] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:20.294218 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b8d08e43-0879-4b2e-8adc-b7b37f1bb6c2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:20.294714 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b8d08e43-0879-4b2e-8adc-b7b37f1bb6c2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:20.295155 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b8d08e43-0879-4b2e-8adc-b7b37f1bb6c2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:20.295864 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b8d08e43-0879-4b2e-8adc-b7b37f1bb6c2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:20.297015 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b8d08e43-0879-4b2e-8adc-b7b37f1bb6c2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:20.297266 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b8d08e43-0879-4b2e-8adc-b7b37f1bb6c2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:20.395734 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-0f99a3ea-bc53-4467-a9dd-6267ee591be8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:02:20.403696 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-0f99a3ea-bc53-4467-a9dd-6267ee591be8 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb" status: 200 len: 1673 microversion: 2.1 time: 0.247421 Oct 03 15:02:20.413722 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 478/994] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:02:20 2022] GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb => generated 1673 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:02:20.436439 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-b8d08e43-0879-4b2e-8adc-b7b37f1bb6c2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:02:20.444649 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-b8d08e43-0879-4b2e-8adc-b7b37f1bb6c2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57" status: 200 len: 1681 microversion: 2.1 time: 0.161840 Oct 03 15:02:20.445216 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 517/995] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:02:20 2022] GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:02:20.797640 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-ef2ea150-2210-4883-b84d-f6c61896fea3 req-91c007d5-d8c6-4952-9c81-0fbc5e2448a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cf56714-ab05-4dc1-ae52-0100ec2d6aeb", "name": "network-vif-deleted", "tag": "94d80152-f32d-4385-b2c7-39409ac0316c"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:02:20.807573 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-ef2ea150-2210-4883-b84d-f6c61896fea3 req-91c007d5-d8c6-4952-9c81-0fbc5e2448a2 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:20.808184 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-ef2ea150-2210-4883-b84d-f6c61896fea3 req-91c007d5-d8c6-4952-9c81-0fbc5e2448a2 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:20.808746 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-ef2ea150-2210-4883-b84d-f6c61896fea3 req-91c007d5-d8c6-4952-9c81-0fbc5e2448a2 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:20.820677 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-ef2ea150-2210-4883-b84d-f6c61896fea3 req-91c007d5-d8c6-4952-9c81-0fbc5e2448a2 service nova] Creating event network-vif-deleted:94d80152-f32d-4385-b2c7-39409ac0316c for instance 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb on hv-cinder-85987 Oct 03 15:02:20.825930 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-ef2ea150-2210-4883-b84d-f6c61896fea3 req-91c007d5-d8c6-4952-9c81-0fbc5e2448a2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032653 Oct 03 15:02:20.826797 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 479/996] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 15:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:02:21.348539 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-5a4974bc-b964-4a05-ac59-f3def039b5b7 req-deb643ca-23ce-4dd9-85d8-48328d08e2fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f9c9350-8239-4025-852c-17a10acd5f57", "name": "network-vif-deleted", "tag": "97ee8f9f-5e7f-49f2-afe8-8afadaf3dfba"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:02:21.359828 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-5a4974bc-b964-4a05-ac59-f3def039b5b7 req-deb643ca-23ce-4dd9-85d8-48328d08e2fd service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:21.360605 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-5a4974bc-b964-4a05-ac59-f3def039b5b7 req-deb643ca-23ce-4dd9-85d8-48328d08e2fd service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:21.361259 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-5a4974bc-b964-4a05-ac59-f3def039b5b7 req-deb643ca-23ce-4dd9-85d8-48328d08e2fd service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:21.373176 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-5a4974bc-b964-4a05-ac59-f3def039b5b7 req-deb643ca-23ce-4dd9-85d8-48328d08e2fd service nova] Creating event network-vif-deleted:97ee8f9f-5e7f-49f2-afe8-8afadaf3dfba for instance 8f9c9350-8239-4025-852c-17a10acd5f57 on hv-cinder-85987 Oct 03 15:02:21.378719 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-5a4974bc-b964-4a05-ac59-f3def039b5b7 req-deb643ca-23ce-4dd9-85d8-48328d08e2fd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033961 Oct 03 15:02:21.379490 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 518/997] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 15:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:02:21.429259 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-0bbc1cfd-0c67-40cc-97ea-1a2fb71dc593 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:21.431402 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-0bbc1cfd-0c67-40cc-97ea-1a2fb71dc593 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:21.440123 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0bbc1cfd-0c67-40cc-97ea-1a2fb71dc593 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:21.440841 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0bbc1cfd-0c67-40cc-97ea-1a2fb71dc593 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:21.441657 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0bbc1cfd-0c67-40cc-97ea-1a2fb71dc593 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:21.443738 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0bbc1cfd-0c67-40cc-97ea-1a2fb71dc593 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:21.444171 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0bbc1cfd-0c67-40cc-97ea-1a2fb71dc593 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:21.444618 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0bbc1cfd-0c67-40cc-97ea-1a2fb71dc593 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:21.469823 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-cca94962-34d1-47a8-9403-d76253d722fc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:21.470872 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-cca94962-34d1-47a8-9403-d76253d722fc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 8f9c9350-8239-4025-852c-17a10acd5f57] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:21.479665 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cca94962-34d1-47a8-9403-d76253d722fc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:21.480158 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cca94962-34d1-47a8-9403-d76253d722fc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:21.480607 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cca94962-34d1-47a8-9403-d76253d722fc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:21.481306 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cca94962-34d1-47a8-9403-d76253d722fc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:21.481792 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cca94962-34d1-47a8-9403-d76253d722fc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:21.482221 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-cca94962-34d1-47a8-9403-d76253d722fc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:21.550549 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0bbc1cfd-0c67-40cc-97ea-1a2fb71dc593 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:21.551065 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0bbc1cfd-0c67-40cc-97ea-1a2fb71dc593 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:21.551489 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0bbc1cfd-0c67-40cc-97ea-1a2fb71dc593 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:21.559189 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.objects.instance [None req-0bbc1cfd-0c67-40cc-97ea-1a2fb71dc593 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lazy-loading 'fault' on Instance uuid 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb {{(pid=126852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:02:21.651708 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-0bbc1cfd-0c67-40cc-97ea-1a2fb71dc593 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be78e1abb3947a2ac5881b9fd2f6fae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf070b7d6ff419392acaddbbee1e242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:02:21.658927 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-0bbc1cfd-0c67-40cc-97ea-1a2fb71dc593 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb" status: 200 len: 1327 microversion: 2.1 time: 0.235517 Oct 03 15:02:21.659448 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 480/998] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:02:21 2022] GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb => generated 1327 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:02:21.679619 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-cca94962-34d1-47a8-9403-d76253d722fc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c747f18b434e469ae61755e9f639ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f441c0592cd146d3be851ac96cbc49dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:02:21.690111 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-cca94962-34d1-47a8-9403-d76253d722fc tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57" status: 200 len: 1327 microversion: 2.1 time: 0.226034 Oct 03 15:02:21.690982 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 519/999] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:02:21 2022] GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57 => generated 1327 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:02:22.684687 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-ccfa8414-769a-458e-8696-abb4514e9909 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:22.685305 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-ccfa8414-769a-458e-8696-abb4514e9909 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:22.693132 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ccfa8414-769a-458e-8696-abb4514e9909 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:22.693649 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ccfa8414-769a-458e-8696-abb4514e9909 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:22.694091 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ccfa8414-769a-458e-8696-abb4514e9909 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:22.694789 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ccfa8414-769a-458e-8696-abb4514e9909 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:22.695246 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ccfa8414-769a-458e-8696-abb4514e9909 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:22.695673 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ccfa8414-769a-458e-8696-abb4514e9909 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:22.709688 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.wsgi [None req-ccfa8414-769a-458e-8696-abb4514e9909 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] HTTP exception thrown: Instance 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb could not be found. Oct 03 15:02:22.711342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-ccfa8414-769a-458e-8696-abb4514e9909 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Request method failure captured: Oct 03 15:02:22.711342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: request: GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb HTTP/1.1 Oct 03 15:02:22.711342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept: application/json Oct 03 15:02:22.711342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept-Encoding: identity Oct 03 15:02:22.711342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Connection: close Oct 03 15:02:22.711342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Length: 0 Oct 03 15:02:22.711342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Type: application/json Oct 03 15:02:22.711342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Host: 10.222.0.46 Oct 03 15:02:22.711342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Openstack-System-Scope: None Oct 03 15:02:22.711342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: User-Agent: python-urllib3/1.26.12 Oct 03 15:02:22.711342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Auth-Token: gAAAAABjOvcaBeyMTa88-0edz76OnaFj6uQQkiDsj4RLm8DiMF0Iy4KLXwqGA78nWIpmhaQ734BRxk6Um4V3DJ-EQp08k-8tzCH5HGef2o3hED3l5byC0hOi3LBM8pwAaKJMM5KxgspcKqQWsBzVq0V47S8aeDU3HrFE8sKEsc7_PFQWOAR-xfg Oct 03 15:02:22.711342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Id: None Oct 03 15:02:22.711342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Name: None Oct 03 15:02:22.711342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Identity-Status: Confirmed Oct 03 15:02:22.711342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Is-Admin-Project: True Oct 03 15:02:22.711342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Id: default Oct 03 15:02:22.711342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Name: Default Oct 03 15:02:22.711342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Id: 8cf070b7d6ff419392acaddbbee1e242 Oct 03 15:02:22.711342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Name: tempest-AttachVolumeTestJSON-1551759992 Oct 03 15:02:22.711342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Role: member,reader Oct 03 15:02:22.711342 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Roles: member,reader Oct 03 15:02:22.712953 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8cf070b7d6ff419392acaddbbee1e242"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8cf070b7d6ff419392acaddbbee1e242"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8cf070b7d6ff419392acaddbbee1e242"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8cf070b7d6ff419392acaddbbee1e242"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 15:02:22.712953 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant: tempest-AttachVolumeTestJSON-1551759992 Oct 03 15:02:22.712953 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Id: 8cf070b7d6ff419392acaddbbee1e242 Oct 03 15:02:22.712953 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1551759992 Oct 03 15:02:22.712953 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User: tempest-AttachVolumeTestJSON-1551759992-project Oct 03 15:02:22.712953 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Id: default Oct 03 15:02:22.712953 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Name: Default Oct 03 15:02:22.712953 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Id: 0be78e1abb3947a2ac5881b9fd2f6fae Oct 03 15:02:22.712953 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Name: tempest-AttachVolumeTestJSON-1551759992-project Oct 03 15:02:22.712953 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: method: > Oct 03 15:02:22.712953 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: exception: Instance 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb could not be found. Oct 03 15:02:22.712953 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: action_args: {'id': '8cf56714-ab05-4dc1-ae52-0100ec2d6aeb'} Oct 03 15:02:22.713879 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:02:22.713879 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:22.713879 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:02:22.713879 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:02:22.713879 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:02:22.713879 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:02:22.713879 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:02:22.713879 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:02:22.713879 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:02:22.713879 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:02:22.713879 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb could not be found. Oct 03 15:02:22.713879 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:22.713879 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:22.713879 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:22.713879 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:22.713879 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:22.713879 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:22.713879 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:02:22.713879 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:02:22.713879 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:02:22.715374 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:02:22.715374 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:02:22.715374 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:02:22.715374 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:02:22.715374 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:02:22.715374 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:02:22.715374 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:02:22.715374 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb could not be found. Oct 03 15:02:22.715374 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:22.715374 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:22.715374 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:22.715374 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:22.715374 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:22.715374 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:22.715374 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:02:22.715374 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:02:22.715374 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb could not be found. Oct 03 15:02:22.715374 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:22.716681 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-ccfa8414-769a-458e-8696-abb4514e9909 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Returning 404 to user: Instance 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb could not be found. {{(pid=126852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:02:22.716681 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-ccfa8414-769a-458e-8696-abb4514e9909 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb" status: 404 len: 111 microversion: 2.1 time: 0.031987 Oct 03 15:02:22.716681 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 481/1000] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:02:22 2022] GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:02:22.716937 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-7060959b-5cd2-45a4-979b-4aa3495f2079 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:22.716937 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-7060959b-5cd2-45a4-979b-4aa3495f2079 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 8f9c9350-8239-4025-852c-17a10acd5f57] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:22.721423 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-ce96d2a8-7dd1-4173-851c-509012d6f05f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '.version_select at 0x7fe0d35813a0>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:22.722457 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7060959b-5cd2-45a4-979b-4aa3495f2079 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:22.722938 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7060959b-5cd2-45a4-979b-4aa3495f2079 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:22.723369 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7060959b-5cd2-45a4-979b-4aa3495f2079 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:22.724060 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7060959b-5cd2-45a4-979b-4aa3495f2079 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:22.724537 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7060959b-5cd2-45a4-979b-4aa3495f2079 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:22.724956 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7060959b-5cd2-45a4-979b-4aa3495f2079 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:22.738431 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.wsgi [None req-7060959b-5cd2-45a4-979b-4aa3495f2079 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] HTTP exception thrown: Instance 8f9c9350-8239-4025-852c-17a10acd5f57 could not be found. Oct 03 15:02:22.739402 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-ce96d2a8-7dd1-4173-851c-509012d6f05f tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-307646498" status: 202 len: 0 microversion: 2.1 time: 0.021730 Oct 03 15:02:22.739966 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 482/1001] 10.222.0.46 () {58 vars in 1218 bytes} [Mon Oct 3 15:02:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-307646498 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 15:02:22.740178 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-7060959b-5cd2-45a4-979b-4aa3495f2079 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Request method failure captured: Oct 03 15:02:22.740178 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: request: GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57 HTTP/1.1 Oct 03 15:02:22.740178 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept: application/json Oct 03 15:02:22.740178 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept-Encoding: identity Oct 03 15:02:22.740178 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Connection: close Oct 03 15:02:22.740178 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Length: 0 Oct 03 15:02:22.740178 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Type: application/json Oct 03 15:02:22.740178 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Host: 10.222.0.46 Oct 03 15:02:22.740178 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Openstack-System-Scope: None Oct 03 15:02:22.740178 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: User-Agent: python-urllib3/1.26.12 Oct 03 15:02:22.740178 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Auth-Token: gAAAAABjOvcPpmkNazTZsKwP_dytsSc1mWeaFG9s70fvVPaYpq_ArFEvYfc7mC1blzmQmSzzs7KJ6XurvcTxRDIyBJ5kvUsRB0YKc-UpccrxHapwKNSjylJR67P3ZaQN5jh2ABzG340CmXB66R8211hYQUHG14HaVU9UDOYI7_9tJ27nTjX-zUs Oct 03 15:02:22.740178 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Id: None Oct 03 15:02:22.740178 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Name: None Oct 03 15:02:22.740178 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Identity-Status: Confirmed Oct 03 15:02:22.740178 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Is-Admin-Project: True Oct 03 15:02:22.740178 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Id: default Oct 03 15:02:22.740178 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Name: Default Oct 03 15:02:22.740178 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Id: f441c0592cd146d3be851ac96cbc49dc Oct 03 15:02:22.740178 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Name: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 15:02:22.740178 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Role: member,reader Oct 03 15:02:22.740178 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Roles: member,reader Oct 03 15:02:22.741874 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 15:02:22.741874 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 15:02:22.741874 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Id: f441c0592cd146d3be851ac96cbc49dc Oct 03 15:02:22.741874 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 15:02:22.741874 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User: tempest-AttachVolumeNegativeTest-1566300421-project Oct 03 15:02:22.741874 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Id: default Oct 03 15:02:22.741874 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Name: Default Oct 03 15:02:22.741874 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Id: 89c747f18b434e469ae61755e9f639ca Oct 03 15:02:22.741874 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Name: tempest-AttachVolumeNegativeTest-1566300421-project Oct 03 15:02:22.741874 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: method: > Oct 03 15:02:22.741874 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: exception: Instance 8f9c9350-8239-4025-852c-17a10acd5f57 could not be found. Oct 03 15:02:22.741874 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: action_args: {'id': '8f9c9350-8239-4025-852c-17a10acd5f57'} Oct 03 15:02:22.742754 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:02:22.742754 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:22.742754 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:02:22.742754 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:02:22.742754 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:02:22.742754 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:02:22.742754 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:02:22.742754 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:02:22.742754 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:02:22.742754 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:02:22.742754 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f9c9350-8239-4025-852c-17a10acd5f57 could not be found. Oct 03 15:02:22.742754 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:22.742754 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:22.742754 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:22.742754 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:22.742754 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:22.742754 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:22.742754 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:02:22.742754 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:02:22.742754 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:02:22.744552 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:02:22.744552 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:02:22.744552 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:02:22.744552 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:02:22.744552 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:02:22.744552 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:02:22.744552 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:02:22.744552 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f9c9350-8239-4025-852c-17a10acd5f57 could not be found. Oct 03 15:02:22.744552 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:22.744552 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:22.744552 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:22.744552 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:22.744552 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:22.744552 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:22.744552 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:02:22.744552 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:02:22.744552 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f9c9350-8239-4025-852c-17a10acd5f57 could not be found. Oct 03 15:02:22.744552 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:22.746482 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-7060959b-5cd2-45a4-979b-4aa3495f2079 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Returning 404 to user: Instance 8f9c9350-8239-4025-852c-17a10acd5f57 could not be found. {{(pid=126851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:02:22.746482 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-7060959b-5cd2-45a4-979b-4aa3495f2079 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57" status: 404 len: 111 microversion: 2.1 time: 0.031944 Oct 03 15:02:22.746482 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 520/1002] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:02:22 2022] GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 15:02:22.750604 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-356f5c55-c63e-4a20-ae7c-60ef93bbb6cd tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '.version_select at 0x7fe0d3580550>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:22.773355 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-356f5c55-c63e-4a20-ae7c-60ef93bbb6cd tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2068502486" status: 202 len: 0 microversion: 2.1 time: 0.026809 Oct 03 15:02:22.774187 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 483/1003] 10.222.0.46 () {58 vars in 1221 bytes} [Mon Oct 3 15:02:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2068502486 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:02:24.547231 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-3a5b5a56-dafe-4729-84bc-a20e3e98c9ec tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:24.547690 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-3a5b5a56-dafe-4729-84bc-a20e3e98c9ec tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 8f9c9350-8239-4025-852c-17a10acd5f57] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:24.553970 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3a5b5a56-dafe-4729-84bc-a20e3e98c9ec tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:24.554560 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3a5b5a56-dafe-4729-84bc-a20e3e98c9ec tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:24.554946 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3a5b5a56-dafe-4729-84bc-a20e3e98c9ec tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:24.555692 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3a5b5a56-dafe-4729-84bc-a20e3e98c9ec tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:24.556147 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3a5b5a56-dafe-4729-84bc-a20e3e98c9ec tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:24.556628 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3a5b5a56-dafe-4729-84bc-a20e3e98c9ec tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:24.570873 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.wsgi [None req-3a5b5a56-dafe-4729-84bc-a20e3e98c9ec tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] HTTP exception thrown: Instance 8f9c9350-8239-4025-852c-17a10acd5f57 could not be found. Oct 03 15:02:24.572409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-3a5b5a56-dafe-4729-84bc-a20e3e98c9ec tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Request method failure captured: Oct 03 15:02:24.572409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: request: DELETE /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57 HTTP/1.1 Oct 03 15:02:24.572409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept: application/json Oct 03 15:02:24.572409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept-Encoding: identity Oct 03 15:02:24.572409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Connection: close Oct 03 15:02:24.572409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Length: 0 Oct 03 15:02:24.572409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Type: application/json Oct 03 15:02:24.572409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Host: 10.222.0.46 Oct 03 15:02:24.572409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Openstack-System-Scope: None Oct 03 15:02:24.572409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: User-Agent: python-urllib3/1.26.12 Oct 03 15:02:24.572409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Auth-Token: gAAAAABjOvcPpmkNazTZsKwP_dytsSc1mWeaFG9s70fvVPaYpq_ArFEvYfc7mC1blzmQmSzzs7KJ6XurvcTxRDIyBJ5kvUsRB0YKc-UpccrxHapwKNSjylJR67P3ZaQN5jh2ABzG340CmXB66R8211hYQUHG14HaVU9UDOYI7_9tJ27nTjX-zUs Oct 03 15:02:24.572409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Id: None Oct 03 15:02:24.572409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Name: None Oct 03 15:02:24.572409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Identity-Status: Confirmed Oct 03 15:02:24.572409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Is-Admin-Project: True Oct 03 15:02:24.572409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Id: default Oct 03 15:02:24.572409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Name: Default Oct 03 15:02:24.572409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Id: f441c0592cd146d3be851ac96cbc49dc Oct 03 15:02:24.572409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Name: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 15:02:24.572409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Role: member,reader Oct 03 15:02:24.572409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Roles: member,reader Oct 03 15:02:24.574091 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 15:02:24.574091 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 15:02:24.574091 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Id: f441c0592cd146d3be851ac96cbc49dc Oct 03 15:02:24.574091 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 15:02:24.574091 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User: tempest-AttachVolumeNegativeTest-1566300421-project Oct 03 15:02:24.574091 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Id: default Oct 03 15:02:24.574091 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Name: Default Oct 03 15:02:24.574091 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Id: 89c747f18b434e469ae61755e9f639ca Oct 03 15:02:24.574091 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Name: tempest-AttachVolumeNegativeTest-1566300421-project Oct 03 15:02:24.574091 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: method: > Oct 03 15:02:24.574091 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: exception: Instance 8f9c9350-8239-4025-852c-17a10acd5f57 could not be found. Oct 03 15:02:24.574091 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: action_args: {'id': '8f9c9350-8239-4025-852c-17a10acd5f57'} Oct 03 15:02:24.575383 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:02:24.575383 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:24.575383 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:02:24.575383 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:02:24.575383 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:02:24.575383 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:02:24.575383 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:02:24.575383 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:02:24.575383 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:02:24.575383 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:02:24.575383 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f9c9350-8239-4025-852c-17a10acd5f57 could not be found. Oct 03 15:02:24.575383 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:24.575383 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:24.575383 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:24.575383 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:24.575383 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:24.575383 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:24.575383 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:02:24.575383 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:02:24.575383 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:02:24.576890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:02:24.576890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 15:02:24.576890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 15:02:24.576890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 15:02:24.576890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 15:02:24.576890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:02:24.576890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:02:24.576890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:02:24.576890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:02:24.576890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f9c9350-8239-4025-852c-17a10acd5f57 could not be found. Oct 03 15:02:24.576890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:24.576890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:24.576890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:24.576890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:24.576890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:24.576890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:24.576890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:02:24.576890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:02:24.576890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f9c9350-8239-4025-852c-17a10acd5f57 could not be found. Oct 03 15:02:24.576890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:24.578497 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-3a5b5a56-dafe-4729-84bc-a20e3e98c9ec tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Returning 404 to user: Instance 8f9c9350-8239-4025-852c-17a10acd5f57 could not be found. {{(pid=126851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:02:24.578497 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-3a5b5a56-dafe-4729-84bc-a20e3e98c9ec tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57" status: 404 len: 111 microversion: 2.1 time: 0.030939 Oct 03 15:02:24.579932 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 521/1004] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 3 15:02:24 2022] DELETE /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:02:24.584828 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-ecae7cdc-ad17-4ece-a66a-bbbc18e3c639 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:24.585591 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-ecae7cdc-ad17-4ece-a66a-bbbc18e3c639 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 8f9c9350-8239-4025-852c-17a10acd5f57] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:24.591903 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ecae7cdc-ad17-4ece-a66a-bbbc18e3c639 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:24.592384 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ecae7cdc-ad17-4ece-a66a-bbbc18e3c639 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:24.592815 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ecae7cdc-ad17-4ece-a66a-bbbc18e3c639 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:24.593532 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ecae7cdc-ad17-4ece-a66a-bbbc18e3c639 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:24.593973 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ecae7cdc-ad17-4ece-a66a-bbbc18e3c639 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:24.594391 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ecae7cdc-ad17-4ece-a66a-bbbc18e3c639 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:24.607749 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.wsgi [None req-ecae7cdc-ad17-4ece-a66a-bbbc18e3c639 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] HTTP exception thrown: Instance 8f9c9350-8239-4025-852c-17a10acd5f57 could not be found. Oct 03 15:02:24.609844 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-ecae7cdc-ad17-4ece-a66a-bbbc18e3c639 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Request method failure captured: Oct 03 15:02:24.609844 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: request: GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57 HTTP/1.1 Oct 03 15:02:24.609844 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept: application/json Oct 03 15:02:24.609844 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept-Encoding: identity Oct 03 15:02:24.609844 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Connection: close Oct 03 15:02:24.609844 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Length: 0 Oct 03 15:02:24.609844 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Type: application/json Oct 03 15:02:24.609844 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Host: 10.222.0.46 Oct 03 15:02:24.609844 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Openstack-System-Scope: None Oct 03 15:02:24.609844 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: User-Agent: python-urllib3/1.26.12 Oct 03 15:02:24.609844 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Auth-Token: gAAAAABjOvcPpmkNazTZsKwP_dytsSc1mWeaFG9s70fvVPaYpq_ArFEvYfc7mC1blzmQmSzzs7KJ6XurvcTxRDIyBJ5kvUsRB0YKc-UpccrxHapwKNSjylJR67P3ZaQN5jh2ABzG340CmXB66R8211hYQUHG14HaVU9UDOYI7_9tJ27nTjX-zUs Oct 03 15:02:24.609844 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Id: None Oct 03 15:02:24.609844 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Name: None Oct 03 15:02:24.609844 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Identity-Status: Confirmed Oct 03 15:02:24.609844 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Is-Admin-Project: True Oct 03 15:02:24.609844 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Id: default Oct 03 15:02:24.609844 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Name: Default Oct 03 15:02:24.609844 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Id: f441c0592cd146d3be851ac96cbc49dc Oct 03 15:02:24.609844 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Name: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 15:02:24.609844 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Role: member,reader Oct 03 15:02:24.609844 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Roles: member,reader Oct 03 15:02:24.611424 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 15:02:24.611424 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 15:02:24.611424 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Id: f441c0592cd146d3be851ac96cbc49dc Oct 03 15:02:24.611424 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 15:02:24.611424 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User: tempest-AttachVolumeNegativeTest-1566300421-project Oct 03 15:02:24.611424 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Id: default Oct 03 15:02:24.611424 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Name: Default Oct 03 15:02:24.611424 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Id: 89c747f18b434e469ae61755e9f639ca Oct 03 15:02:24.611424 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Name: tempest-AttachVolumeNegativeTest-1566300421-project Oct 03 15:02:24.611424 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: method: > Oct 03 15:02:24.611424 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: exception: Instance 8f9c9350-8239-4025-852c-17a10acd5f57 could not be found. Oct 03 15:02:24.611424 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: action_args: {'id': '8f9c9350-8239-4025-852c-17a10acd5f57'} Oct 03 15:02:24.615434 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:02:24.615434 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:24.615434 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:02:24.615434 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:02:24.615434 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:02:24.615434 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:02:24.615434 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:02:24.615434 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:02:24.615434 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:02:24.615434 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:02:24.615434 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f9c9350-8239-4025-852c-17a10acd5f57 could not be found. Oct 03 15:02:24.615434 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:24.615434 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:24.615434 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:24.615434 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:24.615434 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:24.615434 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:24.615434 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:02:24.615434 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:02:24.615434 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:02:24.616915 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:02:24.616915 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:02:24.616915 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:02:24.616915 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:02:24.616915 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:02:24.616915 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:02:24.616915 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:02:24.616915 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f9c9350-8239-4025-852c-17a10acd5f57 could not be found. Oct 03 15:02:24.616915 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:24.616915 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:24.616915 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:24.616915 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:24.616915 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:24.616915 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:24.616915 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:02:24.616915 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:02:24.616915 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f9c9350-8239-4025-852c-17a10acd5f57 could not be found. Oct 03 15:02:24.616915 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:24.618067 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-ecae7cdc-ad17-4ece-a66a-bbbc18e3c639 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Returning 404 to user: Instance 8f9c9350-8239-4025-852c-17a10acd5f57 could not be found. {{(pid=126852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:02:24.618067 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-ecae7cdc-ad17-4ece-a66a-bbbc18e3c639 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57" status: 404 len: 111 microversion: 2.1 time: 0.031713 Oct 03 15:02:24.618067 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 484/1005] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:02:24 2022] GET /compute/v2.1/servers/8f9c9350-8239-4025-852c-17a10acd5f57 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:02:25.660440 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-acc7209e-5592-4090-a002-3e5194fa37dd tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:25.660931 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-acc7209e-5592-4090-a002-3e5194fa37dd tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:25.667181 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-acc7209e-5592-4090-a002-3e5194fa37dd tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:25.667656 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-acc7209e-5592-4090-a002-3e5194fa37dd tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:25.668083 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-acc7209e-5592-4090-a002-3e5194fa37dd tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:25.668765 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-acc7209e-5592-4090-a002-3e5194fa37dd tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:25.669212 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-acc7209e-5592-4090-a002-3e5194fa37dd tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:25.669672 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-acc7209e-5592-4090-a002-3e5194fa37dd tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:25.684493 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.wsgi [None req-acc7209e-5592-4090-a002-3e5194fa37dd tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] HTTP exception thrown: Instance 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb could not be found. Oct 03 15:02:25.686016 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-acc7209e-5592-4090-a002-3e5194fa37dd tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Request method failure captured: Oct 03 15:02:25.686016 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: request: DELETE /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb HTTP/1.1 Oct 03 15:02:25.686016 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept: application/json Oct 03 15:02:25.686016 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept-Encoding: identity Oct 03 15:02:25.686016 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Connection: close Oct 03 15:02:25.686016 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Length: 0 Oct 03 15:02:25.686016 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Type: application/json Oct 03 15:02:25.686016 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Host: 10.222.0.46 Oct 03 15:02:25.686016 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Openstack-System-Scope: None Oct 03 15:02:25.686016 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: User-Agent: python-urllib3/1.26.12 Oct 03 15:02:25.686016 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Auth-Token: gAAAAABjOvcaBeyMTa88-0edz76OnaFj6uQQkiDsj4RLm8DiMF0Iy4KLXwqGA78nWIpmhaQ734BRxk6Um4V3DJ-EQp08k-8tzCH5HGef2o3hED3l5byC0hOi3LBM8pwAaKJMM5KxgspcKqQWsBzVq0V47S8aeDU3HrFE8sKEsc7_PFQWOAR-xfg Oct 03 15:02:25.686016 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Id: None Oct 03 15:02:25.686016 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Name: None Oct 03 15:02:25.686016 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Identity-Status: Confirmed Oct 03 15:02:25.686016 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Is-Admin-Project: True Oct 03 15:02:25.686016 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Id: default Oct 03 15:02:25.686016 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Name: Default Oct 03 15:02:25.686016 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Id: 8cf070b7d6ff419392acaddbbee1e242 Oct 03 15:02:25.686016 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Name: tempest-AttachVolumeTestJSON-1551759992 Oct 03 15:02:25.686016 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Role: member,reader Oct 03 15:02:25.686016 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Roles: member,reader Oct 03 15:02:25.688046 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8cf070b7d6ff419392acaddbbee1e242"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8cf070b7d6ff419392acaddbbee1e242"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8cf070b7d6ff419392acaddbbee1e242"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8cf070b7d6ff419392acaddbbee1e242"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 15:02:25.688046 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant: tempest-AttachVolumeTestJSON-1551759992 Oct 03 15:02:25.688046 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Id: 8cf070b7d6ff419392acaddbbee1e242 Oct 03 15:02:25.688046 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1551759992 Oct 03 15:02:25.688046 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User: tempest-AttachVolumeTestJSON-1551759992-project Oct 03 15:02:25.688046 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Id: default Oct 03 15:02:25.688046 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Name: Default Oct 03 15:02:25.688046 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Id: 0be78e1abb3947a2ac5881b9fd2f6fae Oct 03 15:02:25.688046 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Name: tempest-AttachVolumeTestJSON-1551759992-project Oct 03 15:02:25.688046 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: method: > Oct 03 15:02:25.688046 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: exception: Instance 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb could not be found. Oct 03 15:02:25.688046 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: action_args: {'id': '8cf56714-ab05-4dc1-ae52-0100ec2d6aeb'} Oct 03 15:02:25.688904 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:02:25.688904 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:25.688904 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:02:25.688904 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:02:25.688904 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:02:25.688904 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:02:25.688904 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:02:25.688904 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:02:25.688904 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:02:25.688904 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:02:25.688904 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb could not be found. Oct 03 15:02:25.688904 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:25.688904 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:25.688904 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:25.688904 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:25.688904 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:25.688904 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:25.688904 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:02:25.688904 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:02:25.688904 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:02:25.690375 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:02:25.690375 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 15:02:25.690375 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 15:02:25.690375 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 15:02:25.690375 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 15:02:25.690375 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:02:25.690375 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:02:25.690375 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:02:25.690375 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:02:25.690375 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb could not be found. Oct 03 15:02:25.690375 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:25.690375 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:25.690375 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:25.690375 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:25.690375 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:25.690375 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:25.690375 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:02:25.690375 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:02:25.690375 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb could not be found. Oct 03 15:02:25.690375 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:25.691756 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-acc7209e-5592-4090-a002-3e5194fa37dd tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Returning 404 to user: Instance 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb could not be found. {{(pid=126851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:02:25.691756 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-acc7209e-5592-4090-a002-3e5194fa37dd tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb" status: 404 len: 111 microversion: 2.1 time: 0.031340 Oct 03 15:02:25.691756 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 522/1006] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 3 15:02:25 2022] DELETE /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:02:25.696168 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-44a99804-dd2a-4aaa-8c15-38b9bd0b1560 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:25.696781 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-44a99804-dd2a-4aaa-8c15-38b9bd0b1560 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:25.704019 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-44a99804-dd2a-4aaa-8c15-38b9bd0b1560 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:25.704495 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-44a99804-dd2a-4aaa-8c15-38b9bd0b1560 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:25.704929 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-44a99804-dd2a-4aaa-8c15-38b9bd0b1560 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:25.705641 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-44a99804-dd2a-4aaa-8c15-38b9bd0b1560 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:25.706097 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-44a99804-dd2a-4aaa-8c15-38b9bd0b1560 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:25.706509 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-44a99804-dd2a-4aaa-8c15-38b9bd0b1560 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:25.719635 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.wsgi [None req-44a99804-dd2a-4aaa-8c15-38b9bd0b1560 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] HTTP exception thrown: Instance 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb could not be found. Oct 03 15:02:25.721120 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-44a99804-dd2a-4aaa-8c15-38b9bd0b1560 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Request method failure captured: Oct 03 15:02:25.721120 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: request: GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb HTTP/1.1 Oct 03 15:02:25.721120 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept: application/json Oct 03 15:02:25.721120 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept-Encoding: identity Oct 03 15:02:25.721120 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Connection: close Oct 03 15:02:25.721120 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Length: 0 Oct 03 15:02:25.721120 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Type: application/json Oct 03 15:02:25.721120 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Host: 10.222.0.46 Oct 03 15:02:25.721120 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Openstack-System-Scope: None Oct 03 15:02:25.721120 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: User-Agent: python-urllib3/1.26.12 Oct 03 15:02:25.721120 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Auth-Token: gAAAAABjOvcaBeyMTa88-0edz76OnaFj6uQQkiDsj4RLm8DiMF0Iy4KLXwqGA78nWIpmhaQ734BRxk6Um4V3DJ-EQp08k-8tzCH5HGef2o3hED3l5byC0hOi3LBM8pwAaKJMM5KxgspcKqQWsBzVq0V47S8aeDU3HrFE8sKEsc7_PFQWOAR-xfg Oct 03 15:02:25.721120 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Id: None Oct 03 15:02:25.721120 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Name: None Oct 03 15:02:25.721120 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Identity-Status: Confirmed Oct 03 15:02:25.721120 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Is-Admin-Project: True Oct 03 15:02:25.721120 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Id: default Oct 03 15:02:25.721120 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Name: Default Oct 03 15:02:25.721120 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Id: 8cf070b7d6ff419392acaddbbee1e242 Oct 03 15:02:25.721120 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Name: tempest-AttachVolumeTestJSON-1551759992 Oct 03 15:02:25.721120 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Role: member,reader Oct 03 15:02:25.721120 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Roles: member,reader Oct 03 15:02:25.722693 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8cf070b7d6ff419392acaddbbee1e242"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8cf070b7d6ff419392acaddbbee1e242"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8cf070b7d6ff419392acaddbbee1e242"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8cf070b7d6ff419392acaddbbee1e242"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 15:02:25.722693 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant: tempest-AttachVolumeTestJSON-1551759992 Oct 03 15:02:25.722693 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Id: 8cf070b7d6ff419392acaddbbee1e242 Oct 03 15:02:25.722693 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1551759992 Oct 03 15:02:25.722693 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User: tempest-AttachVolumeTestJSON-1551759992-project Oct 03 15:02:25.722693 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Id: default Oct 03 15:02:25.722693 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Name: Default Oct 03 15:02:25.722693 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Id: 0be78e1abb3947a2ac5881b9fd2f6fae Oct 03 15:02:25.722693 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Name: tempest-AttachVolumeTestJSON-1551759992-project Oct 03 15:02:25.722693 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: method: > Oct 03 15:02:25.722693 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: exception: Instance 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb could not be found. Oct 03 15:02:25.722693 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: action_args: {'id': '8cf56714-ab05-4dc1-ae52-0100ec2d6aeb'} Oct 03 15:02:25.723491 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:02:25.723491 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:25.723491 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:02:25.723491 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:02:25.723491 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:02:25.723491 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:02:25.723491 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:02:25.723491 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:02:25.723491 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:02:25.723491 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:02:25.723491 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb could not be found. Oct 03 15:02:25.723491 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:25.723491 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:25.723491 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:25.723491 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:25.723491 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:25.723491 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:25.723491 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:02:25.723491 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:02:25.723491 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:02:25.725371 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:02:25.725371 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:02:25.725371 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:02:25.725371 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:02:25.725371 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:02:25.725371 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:02:25.725371 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:02:25.725371 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb could not be found. Oct 03 15:02:25.725371 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:25.725371 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:25.725371 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:25.725371 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:25.725371 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:25.725371 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:25.725371 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:02:25.725371 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:02:25.725371 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb could not be found. Oct 03 15:02:25.725371 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:25.726956 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-44a99804-dd2a-4aaa-8c15-38b9bd0b1560 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Returning 404 to user: Instance 8cf56714-ab05-4dc1-ae52-0100ec2d6aeb could not be found. {{(pid=126852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:02:25.726956 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-44a99804-dd2a-4aaa-8c15-38b9bd0b1560 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb" status: 404 len: 111 microversion: 2.1 time: 0.030305 Oct 03 15:02:25.726956 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 485/1007] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:02:25 2022] GET /compute/v2.1/servers/8cf56714-ab05-4dc1-ae52-0100ec2d6aeb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:02:25.747883 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-125b180f-fa7a-4c50-aac6-eed1f8660bbf tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:25.748370 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-125b180f-fa7a-4c50-aac6-eed1f8660bbf tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 78499c1b-6aff-4bab-8bc4-495a949e3637] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:25.754639 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-125b180f-fa7a-4c50-aac6-eed1f8660bbf tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:25.755111 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-125b180f-fa7a-4c50-aac6-eed1f8660bbf tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:25.755540 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-125b180f-fa7a-4c50-aac6-eed1f8660bbf tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:25.756218 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-125b180f-fa7a-4c50-aac6-eed1f8660bbf tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:25.756669 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-125b180f-fa7a-4c50-aac6-eed1f8660bbf tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:25.757086 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-125b180f-fa7a-4c50-aac6-eed1f8660bbf tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:25.923810 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.wsgi [None req-125b180f-fa7a-4c50-aac6-eed1f8660bbf tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] HTTP exception thrown: Instance 78499c1b-6aff-4bab-8bc4-495a949e3637 could not be found. Oct 03 15:02:25.925346 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-125b180f-fa7a-4c50-aac6-eed1f8660bbf tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Request method failure captured: Oct 03 15:02:25.925346 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: request: DELETE /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637 HTTP/1.1 Oct 03 15:02:25.925346 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept: application/json Oct 03 15:02:25.925346 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept-Encoding: identity Oct 03 15:02:25.925346 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Connection: close Oct 03 15:02:25.925346 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Length: 0 Oct 03 15:02:25.925346 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Type: application/json Oct 03 15:02:25.925346 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Host: 10.222.0.46 Oct 03 15:02:25.925346 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Openstack-System-Scope: None Oct 03 15:02:25.925346 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: User-Agent: python-urllib3/1.26.12 Oct 03 15:02:25.925346 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Auth-Token: gAAAAABjOvcPpmkNazTZsKwP_dytsSc1mWeaFG9s70fvVPaYpq_ArFEvYfc7mC1blzmQmSzzs7KJ6XurvcTxRDIyBJ5kvUsRB0YKc-UpccrxHapwKNSjylJR67P3ZaQN5jh2ABzG340CmXB66R8211hYQUHG14HaVU9UDOYI7_9tJ27nTjX-zUs Oct 03 15:02:25.925346 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Id: None Oct 03 15:02:25.925346 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Name: None Oct 03 15:02:25.925346 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Identity-Status: Confirmed Oct 03 15:02:25.925346 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Is-Admin-Project: True Oct 03 15:02:25.925346 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Id: default Oct 03 15:02:25.925346 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Name: Default Oct 03 15:02:25.925346 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Id: f441c0592cd146d3be851ac96cbc49dc Oct 03 15:02:25.925346 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Name: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 15:02:25.925346 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Role: member,reader Oct 03 15:02:25.925346 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Roles: member,reader Oct 03 15:02:25.926959 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 15:02:25.926959 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 15:02:25.926959 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Id: f441c0592cd146d3be851ac96cbc49dc Oct 03 15:02:25.926959 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 15:02:25.926959 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User: tempest-AttachVolumeNegativeTest-1566300421-project Oct 03 15:02:25.926959 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Id: default Oct 03 15:02:25.926959 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Name: Default Oct 03 15:02:25.926959 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Id: 89c747f18b434e469ae61755e9f639ca Oct 03 15:02:25.926959 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Name: tempest-AttachVolumeNegativeTest-1566300421-project Oct 03 15:02:25.926959 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: method: > Oct 03 15:02:25.926959 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: exception: Instance 78499c1b-6aff-4bab-8bc4-495a949e3637 could not be found. Oct 03 15:02:25.926959 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: action_args: {'id': '78499c1b-6aff-4bab-8bc4-495a949e3637'} Oct 03 15:02:25.928039 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:02:25.928039 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:25.928039 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:02:25.928039 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:02:25.928039 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:02:25.928039 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:02:25.928039 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:02:25.928039 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:02:25.928039 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:02:25.928039 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:02:25.928039 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78499c1b-6aff-4bab-8bc4-495a949e3637 could not be found. Oct 03 15:02:25.928039 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:25.928039 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:25.928039 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:25.928039 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:25.928039 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:25.928039 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:25.928039 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:02:25.928039 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:02:25.928039 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:02:25.929622 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:02:25.929622 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 15:02:25.929622 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 15:02:25.929622 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 15:02:25.929622 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 15:02:25.929622 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:02:25.929622 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:02:25.929622 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:02:25.929622 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:02:25.929622 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78499c1b-6aff-4bab-8bc4-495a949e3637 could not be found. Oct 03 15:02:25.929622 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:25.929622 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:25.929622 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:25.929622 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:25.929622 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:25.929622 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:25.929622 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:02:25.929622 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:02:25.929622 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78499c1b-6aff-4bab-8bc4-495a949e3637 could not be found. Oct 03 15:02:25.929622 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:25.931165 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-125b180f-fa7a-4c50-aac6-eed1f8660bbf tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Returning 404 to user: Instance 78499c1b-6aff-4bab-8bc4-495a949e3637 could not be found. {{(pid=126851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:02:25.931165 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-125b180f-fa7a-4c50-aac6-eed1f8660bbf tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "DELETE /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637" status: 404 len: 111 microversion: 2.1 time: 0.182638 Oct 03 15:02:25.931165 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 523/1008] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 3 15:02:25 2022] DELETE /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637 => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:02:25.935125 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-205cb114-e879-46a0-9b8e-33674595f74b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:25.935739 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-205cb114-e879-46a0-9b8e-33674595f74b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: 78499c1b-6aff-4bab-8bc4-495a949e3637] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:25.942097 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-205cb114-e879-46a0-9b8e-33674595f74b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:25.942575 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-205cb114-e879-46a0-9b8e-33674595f74b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:25.943004 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-205cb114-e879-46a0-9b8e-33674595f74b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:25.943684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-205cb114-e879-46a0-9b8e-33674595f74b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:25.944132 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-205cb114-e879-46a0-9b8e-33674595f74b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:25.944553 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-205cb114-e879-46a0-9b8e-33674595f74b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:25.958576 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.wsgi [None req-205cb114-e879-46a0-9b8e-33674595f74b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] HTTP exception thrown: Instance 78499c1b-6aff-4bab-8bc4-495a949e3637 could not be found. Oct 03 15:02:25.960043 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-205cb114-e879-46a0-9b8e-33674595f74b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Request method failure captured: Oct 03 15:02:25.960043 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: request: GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637 HTTP/1.1 Oct 03 15:02:25.960043 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept: application/json Oct 03 15:02:25.960043 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept-Encoding: identity Oct 03 15:02:25.960043 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Connection: close Oct 03 15:02:25.960043 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Length: 0 Oct 03 15:02:25.960043 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Type: application/json Oct 03 15:02:25.960043 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Host: 10.222.0.46 Oct 03 15:02:25.960043 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Openstack-System-Scope: None Oct 03 15:02:25.960043 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: User-Agent: python-urllib3/1.26.12 Oct 03 15:02:25.960043 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Auth-Token: gAAAAABjOvcPpmkNazTZsKwP_dytsSc1mWeaFG9s70fvVPaYpq_ArFEvYfc7mC1blzmQmSzzs7KJ6XurvcTxRDIyBJ5kvUsRB0YKc-UpccrxHapwKNSjylJR67P3ZaQN5jh2ABzG340CmXB66R8211hYQUHG14HaVU9UDOYI7_9tJ27nTjX-zUs Oct 03 15:02:25.960043 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Id: None Oct 03 15:02:25.960043 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Name: None Oct 03 15:02:25.960043 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Identity-Status: Confirmed Oct 03 15:02:25.960043 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Is-Admin-Project: True Oct 03 15:02:25.960043 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Id: default Oct 03 15:02:25.960043 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Name: Default Oct 03 15:02:25.960043 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Id: f441c0592cd146d3be851ac96cbc49dc Oct 03 15:02:25.960043 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Name: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 15:02:25.960043 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Role: member,reader Oct 03 15:02:25.960043 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Roles: member,reader Oct 03 15:02:25.961636 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 15:02:25.961636 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 15:02:25.961636 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Id: f441c0592cd146d3be851ac96cbc49dc Oct 03 15:02:25.961636 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 15:02:25.961636 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User: tempest-AttachVolumeNegativeTest-1566300421-project Oct 03 15:02:25.961636 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Id: default Oct 03 15:02:25.961636 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Name: Default Oct 03 15:02:25.961636 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Id: 89c747f18b434e469ae61755e9f639ca Oct 03 15:02:25.961636 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Name: tempest-AttachVolumeNegativeTest-1566300421-project Oct 03 15:02:25.961636 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: method: > Oct 03 15:02:25.961636 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: exception: Instance 78499c1b-6aff-4bab-8bc4-495a949e3637 could not be found. Oct 03 15:02:25.961636 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: action_args: {'id': '78499c1b-6aff-4bab-8bc4-495a949e3637'} Oct 03 15:02:25.962684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:02:25.962684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:25.962684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:02:25.962684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:02:25.962684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:02:25.962684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:02:25.962684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:02:25.962684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:02:25.962684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:02:25.962684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:02:25.962684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78499c1b-6aff-4bab-8bc4-495a949e3637 could not be found. Oct 03 15:02:25.962684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:25.962684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:25.962684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:25.962684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:25.962684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:25.962684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:25.962684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:02:25.962684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:02:25.962684 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:02:25.964189 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:02:25.964189 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:02:25.964189 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:02:25.964189 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:02:25.964189 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:02:25.964189 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:02:25.964189 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:02:25.964189 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78499c1b-6aff-4bab-8bc4-495a949e3637 could not be found. Oct 03 15:02:25.964189 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:25.964189 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:25.964189 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:25.964189 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:25.964189 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:25.964189 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:25.964189 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:02:25.964189 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:02:25.964189 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78499c1b-6aff-4bab-8bc4-495a949e3637 could not be found. Oct 03 15:02:25.964189 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:25.965584 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-205cb114-e879-46a0-9b8e-33674595f74b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Returning 404 to user: Instance 78499c1b-6aff-4bab-8bc4-495a949e3637 could not be found. {{(pid=126852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:02:25.965584 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-205cb114-e879-46a0-9b8e-33674595f74b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637" status: 404 len: 111 microversion: 2.1 time: 0.030034 Oct 03 15:02:25.965584 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 486/1009] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:02:25 2022] GET /compute/v2.1/servers/78499c1b-6aff-4bab-8bc4-495a949e3637 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:02:25.969550 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-ba3b63d8-ba72-49c6-a6a6-0132802f611f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:25.970045 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-ba3b63d8-ba72-49c6-a6a6-0132802f611f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: f8993421-0b03-4554-aa82-b608a3baebe2] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:25.975870 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ba3b63d8-ba72-49c6-a6a6-0132802f611f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:25.976348 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ba3b63d8-ba72-49c6-a6a6-0132802f611f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:25.976777 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ba3b63d8-ba72-49c6-a6a6-0132802f611f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:25.977460 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ba3b63d8-ba72-49c6-a6a6-0132802f611f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:25.977940 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ba3b63d8-ba72-49c6-a6a6-0132802f611f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:25.978365 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ba3b63d8-ba72-49c6-a6a6-0132802f611f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:25.991039 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.wsgi [None req-ba3b63d8-ba72-49c6-a6a6-0132802f611f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] HTTP exception thrown: Instance f8993421-0b03-4554-aa82-b608a3baebe2 could not be found. Oct 03 15:02:25.992579 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-ba3b63d8-ba72-49c6-a6a6-0132802f611f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Request method failure captured: Oct 03 15:02:25.992579 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: request: DELETE /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2 HTTP/1.1 Oct 03 15:02:25.992579 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept: application/json Oct 03 15:02:25.992579 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept-Encoding: identity Oct 03 15:02:25.992579 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Connection: close Oct 03 15:02:25.992579 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Length: 0 Oct 03 15:02:25.992579 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Type: application/json Oct 03 15:02:25.992579 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Host: 10.222.0.46 Oct 03 15:02:25.992579 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Openstack-System-Scope: None Oct 03 15:02:25.992579 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: User-Agent: python-urllib3/1.26.12 Oct 03 15:02:25.992579 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Auth-Token: gAAAAABjOvcPpmkNazTZsKwP_dytsSc1mWeaFG9s70fvVPaYpq_ArFEvYfc7mC1blzmQmSzzs7KJ6XurvcTxRDIyBJ5kvUsRB0YKc-UpccrxHapwKNSjylJR67P3ZaQN5jh2ABzG340CmXB66R8211hYQUHG14HaVU9UDOYI7_9tJ27nTjX-zUs Oct 03 15:02:25.992579 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Id: None Oct 03 15:02:25.992579 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Name: None Oct 03 15:02:25.992579 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Identity-Status: Confirmed Oct 03 15:02:25.992579 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Is-Admin-Project: True Oct 03 15:02:25.992579 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Id: default Oct 03 15:02:25.992579 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Name: Default Oct 03 15:02:25.992579 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Id: f441c0592cd146d3be851ac96cbc49dc Oct 03 15:02:25.992579 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Name: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 15:02:25.992579 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Role: member,reader Oct 03 15:02:25.992579 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Roles: member,reader Oct 03 15:02:25.994219 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 15:02:25.994219 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 15:02:25.994219 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Id: f441c0592cd146d3be851ac96cbc49dc Oct 03 15:02:25.994219 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 15:02:25.994219 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User: tempest-AttachVolumeNegativeTest-1566300421-project Oct 03 15:02:25.994219 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Id: default Oct 03 15:02:25.994219 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Name: Default Oct 03 15:02:25.994219 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Id: 89c747f18b434e469ae61755e9f639ca Oct 03 15:02:25.994219 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Name: tempest-AttachVolumeNegativeTest-1566300421-project Oct 03 15:02:25.994219 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: method: > Oct 03 15:02:25.994219 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: exception: Instance f8993421-0b03-4554-aa82-b608a3baebe2 could not be found. Oct 03 15:02:25.994219 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: action_args: {'id': 'f8993421-0b03-4554-aa82-b608a3baebe2'} Oct 03 15:02:25.995278 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:02:25.995278 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:25.995278 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:02:25.995278 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:02:25.995278 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:02:25.995278 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:02:25.995278 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:02:25.995278 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:02:25.995278 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:02:25.995278 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:02:25.995278 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8993421-0b03-4554-aa82-b608a3baebe2 could not be found. Oct 03 15:02:25.995278 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:25.995278 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:25.995278 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:25.995278 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:25.995278 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:25.995278 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:25.995278 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:02:25.995278 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:02:25.995278 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:02:25.996788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:02:25.996788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 15:02:25.996788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 15:02:25.996788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 15:02:25.996788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 15:02:25.996788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:02:25.996788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:02:25.996788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:02:25.996788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:02:25.996788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8993421-0b03-4554-aa82-b608a3baebe2 could not be found. Oct 03 15:02:25.996788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:25.996788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:25.996788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:25.996788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:25.996788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:25.996788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:25.996788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:02:25.996788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:02:25.996788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8993421-0b03-4554-aa82-b608a3baebe2 could not be found. Oct 03 15:02:25.996788 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:25.998395 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-ba3b63d8-ba72-49c6-a6a6-0132802f611f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Returning 404 to user: Instance f8993421-0b03-4554-aa82-b608a3baebe2 could not be found. {{(pid=126851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:02:25.998395 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-ba3b63d8-ba72-49c6-a6a6-0132802f611f tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2" status: 404 len: 111 microversion: 2.1 time: 0.028135 Oct 03 15:02:25.998395 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 524/1010] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 3 15:02:25 2022] DELETE /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:02:26.002554 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-a45c7b35-0cea-46db-9a26-cdc5cf270f6e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:26.003191 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-a45c7b35-0cea-46db-9a26-cdc5cf270f6e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: f8993421-0b03-4554-aa82-b608a3baebe2] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:26.009147 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a45c7b35-0cea-46db-9a26-cdc5cf270f6e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:26.009668 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a45c7b35-0cea-46db-9a26-cdc5cf270f6e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:26.010102 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a45c7b35-0cea-46db-9a26-cdc5cf270f6e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:26.010781 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a45c7b35-0cea-46db-9a26-cdc5cf270f6e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:26.011238 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a45c7b35-0cea-46db-9a26-cdc5cf270f6e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:26.011658 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a45c7b35-0cea-46db-9a26-cdc5cf270f6e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:26.025600 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.wsgi [None req-a45c7b35-0cea-46db-9a26-cdc5cf270f6e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] HTTP exception thrown: Instance f8993421-0b03-4554-aa82-b608a3baebe2 could not be found. Oct 03 15:02:26.027096 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-a45c7b35-0cea-46db-9a26-cdc5cf270f6e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Request method failure captured: Oct 03 15:02:26.027096 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: request: GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2 HTTP/1.1 Oct 03 15:02:26.027096 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept: application/json Oct 03 15:02:26.027096 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept-Encoding: identity Oct 03 15:02:26.027096 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Connection: close Oct 03 15:02:26.027096 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Length: 0 Oct 03 15:02:26.027096 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Type: application/json Oct 03 15:02:26.027096 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Host: 10.222.0.46 Oct 03 15:02:26.027096 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Openstack-System-Scope: None Oct 03 15:02:26.027096 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: User-Agent: python-urllib3/1.26.12 Oct 03 15:02:26.027096 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Auth-Token: gAAAAABjOvcPpmkNazTZsKwP_dytsSc1mWeaFG9s70fvVPaYpq_ArFEvYfc7mC1blzmQmSzzs7KJ6XurvcTxRDIyBJ5kvUsRB0YKc-UpccrxHapwKNSjylJR67P3ZaQN5jh2ABzG340CmXB66R8211hYQUHG14HaVU9UDOYI7_9tJ27nTjX-zUs Oct 03 15:02:26.027096 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Id: None Oct 03 15:02:26.027096 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Name: None Oct 03 15:02:26.027096 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Identity-Status: Confirmed Oct 03 15:02:26.027096 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Is-Admin-Project: True Oct 03 15:02:26.027096 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Id: default Oct 03 15:02:26.027096 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Name: Default Oct 03 15:02:26.027096 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Id: f441c0592cd146d3be851ac96cbc49dc Oct 03 15:02:26.027096 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Name: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 15:02:26.027096 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Role: member,reader Oct 03 15:02:26.027096 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Roles: member,reader Oct 03 15:02:26.028676 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 15:02:26.028676 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 15:02:26.028676 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Id: f441c0592cd146d3be851ac96cbc49dc Oct 03 15:02:26.028676 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 15:02:26.028676 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User: tempest-AttachVolumeNegativeTest-1566300421-project Oct 03 15:02:26.028676 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Id: default Oct 03 15:02:26.028676 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Name: Default Oct 03 15:02:26.028676 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Id: 89c747f18b434e469ae61755e9f639ca Oct 03 15:02:26.028676 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Name: tempest-AttachVolumeNegativeTest-1566300421-project Oct 03 15:02:26.028676 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: method: > Oct 03 15:02:26.028676 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: exception: Instance f8993421-0b03-4554-aa82-b608a3baebe2 could not be found. Oct 03 15:02:26.028676 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: action_args: {'id': 'f8993421-0b03-4554-aa82-b608a3baebe2'} Oct 03 15:02:26.029560 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:02:26.029560 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:26.029560 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:02:26.029560 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:02:26.029560 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:02:26.029560 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:02:26.029560 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:02:26.029560 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:02:26.029560 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:02:26.029560 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:02:26.029560 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8993421-0b03-4554-aa82-b608a3baebe2 could not be found. Oct 03 15:02:26.029560 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:26.029560 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:26.029560 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:26.029560 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:26.029560 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:26.029560 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:26.029560 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:02:26.029560 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:02:26.029560 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:02:26.031044 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:02:26.031044 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:02:26.031044 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:02:26.031044 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:02:26.031044 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:02:26.031044 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:02:26.031044 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:02:26.031044 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8993421-0b03-4554-aa82-b608a3baebe2 could not be found. Oct 03 15:02:26.031044 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:26.031044 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:26.031044 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:26.031044 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:26.031044 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:26.031044 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:26.031044 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:02:26.031044 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:02:26.031044 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8993421-0b03-4554-aa82-b608a3baebe2 could not be found. Oct 03 15:02:26.031044 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:26.032422 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-a45c7b35-0cea-46db-9a26-cdc5cf270f6e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Returning 404 to user: Instance f8993421-0b03-4554-aa82-b608a3baebe2 could not be found. {{(pid=126852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:02:26.032422 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-a45c7b35-0cea-46db-9a26-cdc5cf270f6e tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2" status: 404 len: 111 microversion: 2.1 time: 0.030157 Oct 03 15:02:26.032422 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 487/1011] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:02:25 2022] GET /compute/v2.1/servers/f8993421-0b03-4554-aa82-b608a3baebe2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:02:26.871356 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-8e72dd7e-37b1-4c58-a2b7-b7f3c1651c82 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:26.871859 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-8e72dd7e-37b1-4c58-a2b7-b7f3c1651c82 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:26.878213 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8e72dd7e-37b1-4c58-a2b7-b7f3c1651c82 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:26.878693 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8e72dd7e-37b1-4c58-a2b7-b7f3c1651c82 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:26.879128 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8e72dd7e-37b1-4c58-a2b7-b7f3c1651c82 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:26.879815 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8e72dd7e-37b1-4c58-a2b7-b7f3c1651c82 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:26.880270 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8e72dd7e-37b1-4c58-a2b7-b7f3c1651c82 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:26.880693 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8e72dd7e-37b1-4c58-a2b7-b7f3c1651c82 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:26.894201 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.wsgi [None req-8e72dd7e-37b1-4c58-a2b7-b7f3c1651c82 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] HTTP exception thrown: Instance bac89fd1-5f09-42a7-90f2-5074c12859fc could not be found. Oct 03 15:02:26.895708 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-8e72dd7e-37b1-4c58-a2b7-b7f3c1651c82 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Request method failure captured: Oct 03 15:02:26.895708 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: request: DELETE /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc HTTP/1.1 Oct 03 15:02:26.895708 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept: application/json Oct 03 15:02:26.895708 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept-Encoding: identity Oct 03 15:02:26.895708 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Connection: close Oct 03 15:02:26.895708 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Length: 0 Oct 03 15:02:26.895708 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Type: application/json Oct 03 15:02:26.895708 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Host: 10.222.0.46 Oct 03 15:02:26.895708 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Openstack-System-Scope: None Oct 03 15:02:26.895708 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: User-Agent: python-urllib3/1.26.12 Oct 03 15:02:26.895708 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Auth-Token: gAAAAABjOvcaBeyMTa88-0edz76OnaFj6uQQkiDsj4RLm8DiMF0Iy4KLXwqGA78nWIpmhaQ734BRxk6Um4V3DJ-EQp08k-8tzCH5HGef2o3hED3l5byC0hOi3LBM8pwAaKJMM5KxgspcKqQWsBzVq0V47S8aeDU3HrFE8sKEsc7_PFQWOAR-xfg Oct 03 15:02:26.895708 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Id: None Oct 03 15:02:26.895708 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Name: None Oct 03 15:02:26.895708 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Identity-Status: Confirmed Oct 03 15:02:26.895708 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Is-Admin-Project: True Oct 03 15:02:26.895708 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Id: default Oct 03 15:02:26.895708 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Name: Default Oct 03 15:02:26.895708 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Id: 8cf070b7d6ff419392acaddbbee1e242 Oct 03 15:02:26.895708 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Name: tempest-AttachVolumeTestJSON-1551759992 Oct 03 15:02:26.895708 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Role: member,reader Oct 03 15:02:26.895708 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Roles: member,reader Oct 03 15:02:26.897301 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8cf070b7d6ff419392acaddbbee1e242"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8cf070b7d6ff419392acaddbbee1e242"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8cf070b7d6ff419392acaddbbee1e242"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8cf070b7d6ff419392acaddbbee1e242"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 15:02:26.897301 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant: tempest-AttachVolumeTestJSON-1551759992 Oct 03 15:02:26.897301 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Id: 8cf070b7d6ff419392acaddbbee1e242 Oct 03 15:02:26.897301 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1551759992 Oct 03 15:02:26.897301 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User: tempest-AttachVolumeTestJSON-1551759992-project Oct 03 15:02:26.897301 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Id: default Oct 03 15:02:26.897301 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Name: Default Oct 03 15:02:26.897301 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Id: 0be78e1abb3947a2ac5881b9fd2f6fae Oct 03 15:02:26.897301 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Name: tempest-AttachVolumeTestJSON-1551759992-project Oct 03 15:02:26.897301 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: method: > Oct 03 15:02:26.897301 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: exception: Instance bac89fd1-5f09-42a7-90f2-5074c12859fc could not be found. Oct 03 15:02:26.897301 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: action_args: {'id': 'bac89fd1-5f09-42a7-90f2-5074c12859fc'} Oct 03 15:02:26.898146 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:02:26.898146 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:26.898146 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:02:26.898146 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:02:26.898146 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:02:26.898146 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:02:26.898146 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:02:26.898146 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:02:26.898146 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:02:26.898146 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:02:26.898146 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bac89fd1-5f09-42a7-90f2-5074c12859fc could not be found. Oct 03 15:02:26.898146 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:26.898146 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:26.898146 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:26.898146 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:26.898146 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:26.898146 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:26.898146 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:02:26.898146 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:02:26.898146 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:02:26.899524 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:02:26.899524 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 15:02:26.899524 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 15:02:26.899524 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 15:02:26.899524 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 15:02:26.899524 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:02:26.899524 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:02:26.899524 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:02:26.899524 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:02:26.899524 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bac89fd1-5f09-42a7-90f2-5074c12859fc could not be found. Oct 03 15:02:26.899524 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:26.899524 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:26.899524 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:26.899524 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:26.899524 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:26.899524 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:26.899524 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:02:26.899524 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:02:26.899524 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bac89fd1-5f09-42a7-90f2-5074c12859fc could not be found. Oct 03 15:02:26.899524 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:26.901360 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-8e72dd7e-37b1-4c58-a2b7-b7f3c1651c82 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Returning 404 to user: Instance bac89fd1-5f09-42a7-90f2-5074c12859fc could not be found. {{(pid=126851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:02:26.901360 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-8e72dd7e-37b1-4c58-a2b7-b7f3c1651c82 tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "DELETE /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 404 len: 111 microversion: 2.1 time: 0.029468 Oct 03 15:02:26.901360 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 525/1012] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 3 15:02:26 2022] DELETE /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:02:26.906091 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-a4edb2ef-4a14-4858-b435-60904de4d39a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:26.906706 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-a4edb2ef-4a14-4858-b435-60904de4d39a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] [instance: bac89fd1-5f09-42a7-90f2-5074c12859fc] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:26.914373 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a4edb2ef-4a14-4858-b435-60904de4d39a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:26.914889 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a4edb2ef-4a14-4858-b435-60904de4d39a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:26.915486 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a4edb2ef-4a14-4858-b435-60904de4d39a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:26.916490 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a4edb2ef-4a14-4858-b435-60904de4d39a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:26.917335 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a4edb2ef-4a14-4858-b435-60904de4d39a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:26.918120 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a4edb2ef-4a14-4858-b435-60904de4d39a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:26.931852 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.wsgi [None req-a4edb2ef-4a14-4858-b435-60904de4d39a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] HTTP exception thrown: Instance bac89fd1-5f09-42a7-90f2-5074c12859fc could not be found. Oct 03 15:02:26.933384 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-a4edb2ef-4a14-4858-b435-60904de4d39a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Request method failure captured: Oct 03 15:02:26.933384 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: request: GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc HTTP/1.1 Oct 03 15:02:26.933384 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept: application/json Oct 03 15:02:26.933384 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept-Encoding: identity Oct 03 15:02:26.933384 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Connection: close Oct 03 15:02:26.933384 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Length: 0 Oct 03 15:02:26.933384 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Type: application/json Oct 03 15:02:26.933384 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Host: 10.222.0.46 Oct 03 15:02:26.933384 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Openstack-System-Scope: None Oct 03 15:02:26.933384 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: User-Agent: python-urllib3/1.26.12 Oct 03 15:02:26.933384 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Auth-Token: gAAAAABjOvcaBeyMTa88-0edz76OnaFj6uQQkiDsj4RLm8DiMF0Iy4KLXwqGA78nWIpmhaQ734BRxk6Um4V3DJ-EQp08k-8tzCH5HGef2o3hED3l5byC0hOi3LBM8pwAaKJMM5KxgspcKqQWsBzVq0V47S8aeDU3HrFE8sKEsc7_PFQWOAR-xfg Oct 03 15:02:26.933384 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Id: None Oct 03 15:02:26.933384 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Name: None Oct 03 15:02:26.933384 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Identity-Status: Confirmed Oct 03 15:02:26.933384 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Is-Admin-Project: True Oct 03 15:02:26.933384 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Id: default Oct 03 15:02:26.933384 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Name: Default Oct 03 15:02:26.933384 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Id: 8cf070b7d6ff419392acaddbbee1e242 Oct 03 15:02:26.933384 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Name: tempest-AttachVolumeTestJSON-1551759992 Oct 03 15:02:26.933384 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Role: member,reader Oct 03 15:02:26.933384 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Roles: member,reader Oct 03 15:02:26.935008 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8cf070b7d6ff419392acaddbbee1e242"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8cf070b7d6ff419392acaddbbee1e242"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8cf070b7d6ff419392acaddbbee1e242"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8cf070b7d6ff419392acaddbbee1e242"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 15:02:26.935008 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant: tempest-AttachVolumeTestJSON-1551759992 Oct 03 15:02:26.935008 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Id: 8cf070b7d6ff419392acaddbbee1e242 Oct 03 15:02:26.935008 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1551759992 Oct 03 15:02:26.935008 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User: tempest-AttachVolumeTestJSON-1551759992-project Oct 03 15:02:26.935008 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Id: default Oct 03 15:02:26.935008 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Name: Default Oct 03 15:02:26.935008 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Id: 0be78e1abb3947a2ac5881b9fd2f6fae Oct 03 15:02:26.935008 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Name: tempest-AttachVolumeTestJSON-1551759992-project Oct 03 15:02:26.935008 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: method: > Oct 03 15:02:26.935008 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: exception: Instance bac89fd1-5f09-42a7-90f2-5074c12859fc could not be found. Oct 03 15:02:26.935008 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: action_args: {'id': 'bac89fd1-5f09-42a7-90f2-5074c12859fc'} Oct 03 15:02:26.935941 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:02:26.935941 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:26.935941 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:02:26.935941 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:02:26.935941 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:02:26.935941 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:02:26.935941 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:02:26.935941 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:02:26.935941 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:02:26.935941 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:02:26.935941 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bac89fd1-5f09-42a7-90f2-5074c12859fc could not be found. Oct 03 15:02:26.935941 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:26.935941 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:26.935941 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:26.935941 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:26.935941 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:26.935941 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:26.935941 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:02:26.935941 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:02:26.935941 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:02:26.937379 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:02:26.937379 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:02:26.937379 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:02:26.937379 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:02:26.937379 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:02:26.937379 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:02:26.937379 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:02:26.937379 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bac89fd1-5f09-42a7-90f2-5074c12859fc could not be found. Oct 03 15:02:26.937379 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:26.937379 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:26.937379 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:26.937379 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:26.937379 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:26.937379 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:26.937379 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:02:26.937379 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:02:26.937379 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bac89fd1-5f09-42a7-90f2-5074c12859fc could not be found. Oct 03 15:02:26.937379 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:26.938725 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-a4edb2ef-4a14-4858-b435-60904de4d39a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] Returning 404 to user: Instance bac89fd1-5f09-42a7-90f2-5074c12859fc could not be found. {{(pid=126852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:02:26.938725 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-a4edb2ef-4a14-4858-b435-60904de4d39a tempest-AttachVolumeTestJSON-1551759992 tempest-AttachVolumeTestJSON-1551759992-project] 10.222.0.46 "GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc" status: 404 len: 111 microversion: 2.1 time: 0.033266 Oct 03 15:02:26.938725 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 488/1013] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:02:26 2022] GET /compute/v2.1/servers/bac89fd1-5f09-42a7-90f2-5074c12859fc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:02:27.166757 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-6541661d-9585-41a2-8156-5f9cb9ded2c2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:27.167324 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-6541661d-9585-41a2-8156-5f9cb9ded2c2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:27.173789 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6541661d-9585-41a2-8156-5f9cb9ded2c2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:27.174341 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6541661d-9585-41a2-8156-5f9cb9ded2c2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:27.174844 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6541661d-9585-41a2-8156-5f9cb9ded2c2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:27.175539 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6541661d-9585-41a2-8156-5f9cb9ded2c2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:27.176600 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6541661d-9585-41a2-8156-5f9cb9ded2c2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:27.176600 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6541661d-9585-41a2-8156-5f9cb9ded2c2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:27.190957 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.wsgi [None req-6541661d-9585-41a2-8156-5f9cb9ded2c2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] HTTP exception thrown: Instance e89e5bd3-ef0d-4314-b688-10af4dbf02a8 could not be found. Oct 03 15:02:27.192818 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-6541661d-9585-41a2-8156-5f9cb9ded2c2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Request method failure captured: Oct 03 15:02:27.192818 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: request: DELETE /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 HTTP/1.1 Oct 03 15:02:27.192818 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept: application/json Oct 03 15:02:27.192818 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept-Encoding: identity Oct 03 15:02:27.192818 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Connection: close Oct 03 15:02:27.192818 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Length: 0 Oct 03 15:02:27.192818 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Type: application/json Oct 03 15:02:27.192818 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Host: 10.222.0.46 Oct 03 15:02:27.192818 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Openstack-System-Scope: None Oct 03 15:02:27.192818 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: User-Agent: python-urllib3/1.26.12 Oct 03 15:02:27.192818 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Auth-Token: gAAAAABjOvcPpmkNazTZsKwP_dytsSc1mWeaFG9s70fvVPaYpq_ArFEvYfc7mC1blzmQmSzzs7KJ6XurvcTxRDIyBJ5kvUsRB0YKc-UpccrxHapwKNSjylJR67P3ZaQN5jh2ABzG340CmXB66R8211hYQUHG14HaVU9UDOYI7_9tJ27nTjX-zUs Oct 03 15:02:27.192818 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Id: None Oct 03 15:02:27.192818 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Name: None Oct 03 15:02:27.192818 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Identity-Status: Confirmed Oct 03 15:02:27.192818 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Is-Admin-Project: True Oct 03 15:02:27.192818 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Id: default Oct 03 15:02:27.192818 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Name: Default Oct 03 15:02:27.192818 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Id: f441c0592cd146d3be851ac96cbc49dc Oct 03 15:02:27.192818 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Name: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 15:02:27.192818 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Role: member,reader Oct 03 15:02:27.192818 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Roles: member,reader Oct 03 15:02:27.194409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 15:02:27.194409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 15:02:27.194409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Id: f441c0592cd146d3be851ac96cbc49dc Oct 03 15:02:27.194409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 15:02:27.194409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User: tempest-AttachVolumeNegativeTest-1566300421-project Oct 03 15:02:27.194409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Id: default Oct 03 15:02:27.194409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Name: Default Oct 03 15:02:27.194409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Id: 89c747f18b434e469ae61755e9f639ca Oct 03 15:02:27.194409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Name: tempest-AttachVolumeNegativeTest-1566300421-project Oct 03 15:02:27.194409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: method: > Oct 03 15:02:27.194409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: exception: Instance e89e5bd3-ef0d-4314-b688-10af4dbf02a8 could not be found. Oct 03 15:02:27.194409 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: action_args: {'id': 'e89e5bd3-ef0d-4314-b688-10af4dbf02a8'} Oct 03 15:02:27.195264 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:02:27.195264 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:27.195264 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:02:27.195264 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:02:27.195264 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:02:27.195264 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:02:27.195264 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:02:27.195264 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:02:27.195264 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:02:27.195264 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:02:27.195264 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e89e5bd3-ef0d-4314-b688-10af4dbf02a8 could not be found. Oct 03 15:02:27.195264 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:27.195264 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:27.195264 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:27.195264 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:27.195264 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:27.195264 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:27.195264 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:02:27.195264 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:02:27.195264 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:02:27.196618 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:02:27.196618 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 15:02:27.196618 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 15:02:27.196618 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 15:02:27.196618 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 15:02:27.196618 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:02:27.196618 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:02:27.196618 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:02:27.196618 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:02:27.196618 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e89e5bd3-ef0d-4314-b688-10af4dbf02a8 could not be found. Oct 03 15:02:27.196618 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:27.196618 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:27.196618 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:27.196618 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:27.196618 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:27.196618 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:27.196618 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:02:27.196618 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:02:27.196618 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e89e5bd3-ef0d-4314-b688-10af4dbf02a8 could not be found. Oct 03 15:02:27.196618 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:27.197979 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-6541661d-9585-41a2-8156-5f9cb9ded2c2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Returning 404 to user: Instance e89e5bd3-ef0d-4314-b688-10af4dbf02a8 could not be found. {{(pid=126851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:02:27.197979 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-6541661d-9585-41a2-8156-5f9cb9ded2c2 tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 404 len: 111 microversion: 2.1 time: 0.031461 Oct 03 15:02:27.197979 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 526/1014] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 3 15:02:27 2022] DELETE /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:02:27.202844 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-e87e2c41-4231-4daf-aac1-d8ec7895c63b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:27.203456 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-e87e2c41-4231-4daf-aac1-d8ec7895c63b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] [instance: e89e5bd3-ef0d-4314-b688-10af4dbf02a8] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:27.209699 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e87e2c41-4231-4daf-aac1-d8ec7895c63b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:27.210188 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e87e2c41-4231-4daf-aac1-d8ec7895c63b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:27.210628 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e87e2c41-4231-4daf-aac1-d8ec7895c63b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:27.211345 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e87e2c41-4231-4daf-aac1-d8ec7895c63b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:27.211808 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e87e2c41-4231-4daf-aac1-d8ec7895c63b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:27.212233 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e87e2c41-4231-4daf-aac1-d8ec7895c63b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:27.226408 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.wsgi [None req-e87e2c41-4231-4daf-aac1-d8ec7895c63b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] HTTP exception thrown: Instance e89e5bd3-ef0d-4314-b688-10af4dbf02a8 could not be found. Oct 03 15:02:27.227933 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-e87e2c41-4231-4daf-aac1-d8ec7895c63b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Request method failure captured: Oct 03 15:02:27.227933 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: request: GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 HTTP/1.1 Oct 03 15:02:27.227933 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept: application/json Oct 03 15:02:27.227933 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept-Encoding: identity Oct 03 15:02:27.227933 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Connection: close Oct 03 15:02:27.227933 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Length: 0 Oct 03 15:02:27.227933 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Type: application/json Oct 03 15:02:27.227933 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Host: 10.222.0.46 Oct 03 15:02:27.227933 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Openstack-System-Scope: None Oct 03 15:02:27.227933 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: User-Agent: python-urllib3/1.26.12 Oct 03 15:02:27.227933 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Auth-Token: gAAAAABjOvcPpmkNazTZsKwP_dytsSc1mWeaFG9s70fvVPaYpq_ArFEvYfc7mC1blzmQmSzzs7KJ6XurvcTxRDIyBJ5kvUsRB0YKc-UpccrxHapwKNSjylJR67P3ZaQN5jh2ABzG340CmXB66R8211hYQUHG14HaVU9UDOYI7_9tJ27nTjX-zUs Oct 03 15:02:27.227933 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Id: None Oct 03 15:02:27.227933 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Name: None Oct 03 15:02:27.227933 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Identity-Status: Confirmed Oct 03 15:02:27.227933 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Is-Admin-Project: True Oct 03 15:02:27.227933 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Id: default Oct 03 15:02:27.227933 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Name: Default Oct 03 15:02:27.227933 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Id: f441c0592cd146d3be851ac96cbc49dc Oct 03 15:02:27.227933 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Name: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 15:02:27.227933 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Role: member,reader Oct 03 15:02:27.227933 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Roles: member,reader Oct 03 15:02:27.229611 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f441c0592cd146d3be851ac96cbc49dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 15:02:27.229611 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 15:02:27.229611 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Id: f441c0592cd146d3be851ac96cbc49dc Oct 03 15:02:27.229611 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1566300421 Oct 03 15:02:27.229611 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User: tempest-AttachVolumeNegativeTest-1566300421-project Oct 03 15:02:27.229611 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Id: default Oct 03 15:02:27.229611 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Name: Default Oct 03 15:02:27.229611 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Id: 89c747f18b434e469ae61755e9f639ca Oct 03 15:02:27.229611 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Name: tempest-AttachVolumeNegativeTest-1566300421-project Oct 03 15:02:27.229611 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: method: > Oct 03 15:02:27.229611 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: exception: Instance e89e5bd3-ef0d-4314-b688-10af4dbf02a8 could not be found. Oct 03 15:02:27.229611 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: action_args: {'id': 'e89e5bd3-ef0d-4314-b688-10af4dbf02a8'} Oct 03 15:02:27.232107 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:02:27.232107 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:27.232107 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:02:27.232107 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:02:27.232107 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:02:27.232107 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:02:27.232107 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:02:27.232107 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:02:27.232107 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:02:27.232107 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:02:27.232107 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e89e5bd3-ef0d-4314-b688-10af4dbf02a8 could not be found. Oct 03 15:02:27.232107 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:27.232107 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:27.232107 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:27.232107 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:27.232107 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:27.232107 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:27.232107 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:02:27.232107 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:02:27.232107 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:02:27.236527 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:02:27.236527 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:02:27.236527 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:02:27.236527 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:02:27.236527 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:02:27.236527 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:02:27.236527 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:02:27.236527 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e89e5bd3-ef0d-4314-b688-10af4dbf02a8 could not be found. Oct 03 15:02:27.236527 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:27.236527 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:27.236527 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:27.236527 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:27.236527 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:27.236527 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:27.236527 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:02:27.236527 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:02:27.236527 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e89e5bd3-ef0d-4314-b688-10af4dbf02a8 could not be found. Oct 03 15:02:27.236527 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:27.243061 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-e87e2c41-4231-4daf-aac1-d8ec7895c63b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] Returning 404 to user: Instance e89e5bd3-ef0d-4314-b688-10af4dbf02a8 could not be found. {{(pid=126852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:02:27.243061 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-e87e2c41-4231-4daf-aac1-d8ec7895c63b tempest-AttachVolumeNegativeTest-1566300421 tempest-AttachVolumeNegativeTest-1566300421-project] 10.222.0.46 "GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8" status: 404 len: 111 microversion: 2.1 time: 0.030349 Oct 03 15:02:27.244989 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 489/1015] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:02:27 2022] GET /compute/v2.1/servers/e89e5bd3-ef0d-4314-b688-10af4dbf02a8 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 15:02:32.709908 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-7c1f70b3-c28b-4553-aae8-327d5b96e07d tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] Action: 'create', calling method: .version_select at 0x7fe0d6c29820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1877400243"}} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:02:33.018871 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-7c1f70b3-c28b-4553-aae8-327d5b96e07d tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.542508 Oct 03 15:02:33.019620 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 527/1016] 10.222.0.46 () {60 vars in 1155 bytes} [Mon Oct 3 15:02:32 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 544 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 03 15:02:33.039625 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-7a9e92e5-0b83-4719-8f2e-62364a9e54eb tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] Calling method '.version_select at 0x7fe0d35810d0>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:33.092145 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-7a9e92e5-0b83-4719-8f2e-62364a9e54eb tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05" status: 200 len: 345 microversion: 2.1 time: 0.056931 Oct 03 15:02:33.092736 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 490/1017] 10.222.0.46 () {58 vars in 1245 bytes} [Mon Oct 3 15:02:33 2022] GET /compute/v2.1/os-volumes/eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:02:34.110567 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-03abcdc4-bd00-438b-9ecf-617123cf4318 tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] Calling method '.version_select at 0x7fe0d6c128b0>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:34.161818 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-03abcdc4-bd00-438b-9ecf-617123cf4318 tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05" status: 200 len: 346 microversion: 2.1 time: 0.056230 Oct 03 15:02:34.162386 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 528/1018] 10.222.0.46 () {58 vars in 1245 bytes} [Mon Oct 3 15:02:34 2022] GET /compute/v2.1/os-volumes/eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05 => generated 346 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:02:34.176309 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-49841324-7f27-43eb-8648-5bbeb5807879 tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] Action: 'create', calling method: .version_select at 0x7fe0d3580b80>, body: {"snapshot": {"volume_id": "eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1650481726"}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:02:34.339155 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-49841324-7f27-43eb-8648-5bbeb5807879 tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] 10.222.0.46 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.167042 Oct 03 15:02:34.339927 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 491/1019] 10.222.0.46 () {60 vars in 1162 bytes} [Mon Oct 3 15:02:34 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:02:34.353986 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-14288b55-2a49-4941-b653-177893acbe40 tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] Calling method '.version_select at 0x7fe0d37efe50>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:34.390504 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-14288b55-2a49-4941-b653-177893acbe40 tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/f4130d69-e079-4679-a2bd-e2d7d6c707be" status: 200 len: 287 microversion: 2.1 time: 0.040685 Oct 03 15:02:34.390820 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 529/1020] 10.222.0.46 () {58 vars in 1251 bytes} [Mon Oct 3 15:02:34 2022] GET /compute/v2.1/os-snapshots/f4130d69-e079-4679-a2bd-e2d7d6c707be => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:02:34.402279 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-dc3c561b-2a0e-4b56-a522-96844e9a27a1 tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] Calling method '.version_select at 0x7fe0d35340d0>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:34.435094 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-dc3c561b-2a0e-4b56-a522-96844e9a27a1 tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.036865 Oct 03 15:02:34.435673 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 492/1021] 10.222.0.46 () {58 vars in 1140 bytes} [Mon Oct 3 15:02:34 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:02:34.447052 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-ca0662c6-2fe1-4269-b3f6-4eb539d844a0 tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] Calling method '.version_select at 0x7fe0d6c29820>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:34.478317 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-ca0662c6-2fe1-4269-b3f6-4eb539d844a0 tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/f4130d69-e079-4679-a2bd-e2d7d6c707be" status: 200 len: 287 microversion: 2.1 time: 0.035065 Oct 03 15:02:34.479024 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 530/1022] 10.222.0.46 () {58 vars in 1251 bytes} [Mon Oct 3 15:02:34 2022] GET /compute/v2.1/os-snapshots/f4130d69-e079-4679-a2bd-e2d7d6c707be => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:02:35.491693 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-cfd0ba0d-baa8-4fe9-9d66-945b70d18fad tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] Calling method '.version_select at 0x7fe0d3581a60>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:35.521428 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-cfd0ba0d-baa8-4fe9-9d66-945b70d18fad tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/f4130d69-e079-4679-a2bd-e2d7d6c707be" status: 200 len: 287 microversion: 2.1 time: 0.034048 Oct 03 15:02:35.522158 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 493/1023] 10.222.0.46 () {58 vars in 1251 bytes} [Mon Oct 3 15:02:35 2022] GET /compute/v2.1/os-snapshots/f4130d69-e079-4679-a2bd-e2d7d6c707be => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:02:36.534710 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-8b895650-59b6-41f5-bc5d-735ee9b91ce1 tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] Calling method '.version_select at 0x7fe0d3691e50>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:36.564939 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-8b895650-59b6-41f5-bc5d-735ee9b91ce1 tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/f4130d69-e079-4679-a2bd-e2d7d6c707be" status: 200 len: 287 microversion: 2.1 time: 0.034490 Oct 03 15:02:36.565473 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 531/1024] 10.222.0.46 () {58 vars in 1251 bytes} [Mon Oct 3 15:02:36 2022] GET /compute/v2.1/os-snapshots/f4130d69-e079-4679-a2bd-e2d7d6c707be => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:02:37.575052 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=2 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:02:37.575801 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=76,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:02:37.580853 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-d2a6396c-8de2-44e5-a9d9-cc9aacc1fb90 tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] Calling method '.version_select at 0x7fe0d3581e50>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:37.611690 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-d2a6396c-8de2-44e5-a9d9-cc9aacc1fb90 tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/f4130d69-e079-4679-a2bd-e2d7d6c707be" status: 200 len: 287 microversion: 2.1 time: 0.038024 Oct 03 15:02:37.612260 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 494/1025] 10.222.0.46 () {58 vars in 1251 bytes} [Mon Oct 3 15:02:37 2022] GET /compute/v2.1/os-snapshots/f4130d69-e079-4679-a2bd-e2d7d6c707be => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:02:38.621199 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:02:38.622583 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:02:38.627283 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-958344fd-b25f-48e7-be8c-485724f9bc35 tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] Calling method '.version_select at 0x7fe0d6c120d0>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:38.660185 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-958344fd-b25f-48e7-be8c-485724f9bc35 tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/f4130d69-e079-4679-a2bd-e2d7d6c707be" status: 200 len: 287 microversion: 2.1 time: 0.039374 Oct 03 15:02:38.660754 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 532/1026] 10.222.0.46 () {58 vars in 1251 bytes} [Mon Oct 3 15:02:38 2022] GET /compute/v2.1/os-snapshots/f4130d69-e079-4679-a2bd-e2d7d6c707be => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:02:38.784037 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-adc3988b-525b-484a-8997-98f9def100b8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:38.786358 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-adc3988b-525b-484a-8997-98f9def100b8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:38.793349 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-adc3988b-525b-484a-8997-98f9def100b8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:38.793886 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-adc3988b-525b-484a-8997-98f9def100b8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:38.794322 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-adc3988b-525b-484a-8997-98f9def100b8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:38.795037 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-adc3988b-525b-484a-8997-98f9def100b8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:38.795518 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-adc3988b-525b-484a-8997-98f9def100b8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:38.795927 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-adc3988b-525b-484a-8997-98f9def100b8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:38.828616 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-adc3988b-525b-484a-8997-98f9def100b8 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048953 Oct 03 15:02:38.829691 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 495/1027] 10.222.0.46 () {60 vars in 1343 bytes} [Mon Oct 3 15:02:38 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:02:38.895497 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-2a342492-a8cf-4922-b710-4a3daf64e063 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:38.895992 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-2a342492-a8cf-4922-b710-4a3daf64e063 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:38.902106 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2a342492-a8cf-4922-b710-4a3daf64e063 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:38.902593 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2a342492-a8cf-4922-b710-4a3daf64e063 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:38.903027 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2a342492-a8cf-4922-b710-4a3daf64e063 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:38.903723 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2a342492-a8cf-4922-b710-4a3daf64e063 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:38.904178 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2a342492-a8cf-4922-b710-4a3daf64e063 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:38.905081 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2a342492-a8cf-4922-b710-4a3daf64e063 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:38.930578 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-2a342492-a8cf-4922-b710-4a3daf64e063 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Going to try to terminate instance {{(pid=126851) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:02:39.015927 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-2a342492-a8cf-4922-b710-4a3daf64e063 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "DELETE /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 204 len: 0 microversion: 2.20 time: 0.123979 Oct 03 15:02:39.016519 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 533/1028] 10.222.0.46 () {60 vars in 1280 bytes} [Mon Oct 3 15:02:38 2022] DELETE /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 15:02:39.024778 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-03b1ca08-97dd-4ea7-b3f0-efe602264c5d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:39.025481 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-03b1ca08-97dd-4ea7-b3f0-efe602264c5d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:39.032106 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-03b1ca08-97dd-4ea7-b3f0-efe602264c5d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:39.032669 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-03b1ca08-97dd-4ea7-b3f0-efe602264c5d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:39.033107 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-03b1ca08-97dd-4ea7-b3f0-efe602264c5d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:39.033832 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-03b1ca08-97dd-4ea7-b3f0-efe602264c5d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:39.034289 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-03b1ca08-97dd-4ea7-b3f0-efe602264c5d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:39.034710 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-03b1ca08-97dd-4ea7-b3f0-efe602264c5d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:39.174076 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-03b1ca08-97dd-4ea7-b3f0-efe602264c5d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:02:39.182324 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-03b1ca08-97dd-4ea7-b3f0-efe602264c5d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:02:39.183769 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-03b1ca08-97dd-4ea7-b3f0-efe602264c5d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:02:39.184936 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-03b1ca08-97dd-4ea7-b3f0-efe602264c5d tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1723 microversion: 2.20 time: 0.164035 Oct 03 15:02:39.185552 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 496/1029] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:02:39 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:02:39.673327 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-6f0977d7-37c1-424d-ac2a-9486d9c07f6c tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] Calling method '.version_select at 0x7fe0d6c12e50>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:39.704916 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-6f0977d7-37c1-424d-ac2a-9486d9c07f6c tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/f4130d69-e079-4679-a2bd-e2d7d6c707be" status: 200 len: 288 microversion: 2.1 time: 0.036165 Oct 03 15:02:39.705619 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 534/1030] 10.222.0.46 () {58 vars in 1251 bytes} [Mon Oct 3 15:02:39 2022] GET /compute/v2.1/os-snapshots/f4130d69-e079-4679-a2bd-e2d7d6c707be => generated 288 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:02:39.717212 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-3051f5cc-ce4d-4066-aa0c-2180c1f9b480 tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] Calling method '.version_select at 0x7fe0d3580af0>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:39.774934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-3051f5cc-ce4d-4066-aa0c-2180c1f9b480 tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] 10.222.0.46 "DELETE /compute/v2.1/os-snapshots/f4130d69-e079-4679-a2bd-e2d7d6c707be" status: 202 len: 0 microversion: 2.1 time: 0.061690 Oct 03 15:02:39.775507 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 497/1031] 10.222.0.46 () {58 vars in 1254 bytes} [Mon Oct 3 15:02:39 2022] DELETE /compute/v2.1/os-snapshots/f4130d69-e079-4679-a2bd-e2d7d6c707be => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 15:02:39.784214 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-5e920565-d2d1-4ca2-aae8-790ddab537dd tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] Calling method '.version_select at 0x7fe0d6c84700>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:39.818217 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-5e920565-d2d1-4ca2-aae8-790ddab537dd tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/f4130d69-e079-4679-a2bd-e2d7d6c707be" status: 200 len: 287 microversion: 2.1 time: 0.038197 Oct 03 15:02:39.818968 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 535/1032] 10.222.0.46 () {58 vars in 1251 bytes} [Mon Oct 3 15:02:39 2022] GET /compute/v2.1/os-snapshots/f4130d69-e079-4679-a2bd-e2d7d6c707be => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:02:40.212558 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-a5b0f573-086f-41a0-8ac9-59a4fedf5636 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:40.213813 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-a5b0f573-086f-41a0-8ac9-59a4fedf5636 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:40.219928 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a5b0f573-086f-41a0-8ac9-59a4fedf5636 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:40.220464 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a5b0f573-086f-41a0-8ac9-59a4fedf5636 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:40.220856 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a5b0f573-086f-41a0-8ac9-59a4fedf5636 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:40.221582 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a5b0f573-086f-41a0-8ac9-59a4fedf5636 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:40.222050 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a5b0f573-086f-41a0-8ac9-59a4fedf5636 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:40.222477 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a5b0f573-086f-41a0-8ac9-59a4fedf5636 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:40.605297 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-a5b0f573-086f-41a0-8ac9-59a4fedf5636 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:02:40.613749 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-a5b0f573-086f-41a0-8ac9-59a4fedf5636 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:02:40.615181 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-a5b0f573-086f-41a0-8ac9-59a4fedf5636 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:02:40.616332 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-a5b0f573-086f-41a0-8ac9-59a4fedf5636 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1723 microversion: 2.20 time: 0.408581 Oct 03 15:02:40.616887 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 498/1033] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:02:40 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1723 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:02:40.832914 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-c262a322-a70f-4b0d-8a99-d77f99d10d1a tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] Calling method '.version_select at 0x7fe0d36f04c0>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:40.857800 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.wsgi [None req-c262a322-a70f-4b0d-8a99-d77f99d10d1a tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] HTTP exception thrown: Snapshot f4130d69-e079-4679-a2bd-e2d7d6c707be could not be found. Oct 03 15:02:40.860132 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-c262a322-a70f-4b0d-8a99-d77f99d10d1a tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] Request method failure captured: Oct 03 15:02:40.860132 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: request: GET /compute/v2.1/os-snapshots/f4130d69-e079-4679-a2bd-e2d7d6c707be HTTP/1.1 Oct 03 15:02:40.860132 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept: application/json Oct 03 15:02:40.860132 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept-Encoding: identity Oct 03 15:02:40.860132 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Connection: close Oct 03 15:02:40.860132 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Length: 0 Oct 03 15:02:40.860132 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Type: application/json Oct 03 15:02:40.860132 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Host: 10.222.0.46 Oct 03 15:02:40.860132 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Openstack-System-Scope: None Oct 03 15:02:40.860132 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: User-Agent: python-urllib3/1.26.12 Oct 03 15:02:40.860132 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Auth-Token: gAAAAABjOvmI_TKRilBagY79txXcsD7ziiBMh5XcJc8efmxA80h0dDYOe07jxgNaB4abelXCGzZ3ELkuDnaIY1gqjvFzolBUAJTFsBjDc75sC0kHH1aqU5m__x8XRtevytajV_zCn3-CMAeghz4vhgwYpkqFXoXElTxRxU9JR8jH2Ak6yET4eYA Oct 03 15:02:40.860132 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Id: None Oct 03 15:02:40.860132 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Name: None Oct 03 15:02:40.860132 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Identity-Status: Confirmed Oct 03 15:02:40.860132 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Is-Admin-Project: True Oct 03 15:02:40.860132 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Id: default Oct 03 15:02:40.860132 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Name: Default Oct 03 15:02:40.860132 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Id: 8203ec601e074484b26de4380c9c9257 Oct 03 15:02:40.860132 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1298734599 Oct 03 15:02:40.860132 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Role: member,reader Oct 03 15:02:40.860132 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Roles: member,reader Oct 03 15:02:40.861890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8203ec601e074484b26de4380c9c9257"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8203ec601e074484b26de4380c9c9257"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8203ec601e074484b26de4380c9c9257"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8203ec601e074484b26de4380c9c9257"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 15:02:40.861890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1298734599 Oct 03 15:02:40.861890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Id: 8203ec601e074484b26de4380c9c9257 Oct 03 15:02:40.861890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1298734599 Oct 03 15:02:40.861890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User: tempest-VolumesSnapshotsTestJSON-1298734599-project Oct 03 15:02:40.861890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Id: default Oct 03 15:02:40.861890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Name: Default Oct 03 15:02:40.861890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Id: 9d36c4b97e6b4df780ee04bc02981a30 Oct 03 15:02:40.861890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1298734599-project Oct 03 15:02:40.861890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: method: Oct 03 15:02:40.861890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: exception: Snapshot f4130d69-e079-4679-a2bd-e2d7d6c707be could not be found. Oct 03 15:02:40.861890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: action_args: {'id': 'f4130d69-e079-4679-a2bd-e2d7d6c707be'} Oct 03 15:02:40.861890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:02:40.863077 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:40.863077 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 03 15:02:40.863077 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 03 15:02:40.863077 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 03 15:02:40.863077 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 03 15:02:40.863077 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 03 15:02:40.863077 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 03 15:02:40.863077 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 15:02:40.863077 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 15:02:40.863077 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 15:02:40.863077 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 15:02:40.863077 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 15:02:40.863077 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 15:02:40.863077 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 15:02:40.863077 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 15:02:40.863077 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f4130d69-e079-4679-a2bd-e2d7d6c707be could not be found. (HTTP 404) (Request-ID: req-4d0b9450-26b2-44cb-978e-d78166218ec1) Oct 03 15:02:40.863077 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:40.863077 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:40.864481 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:40.864481 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:40.864481 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 03 15:02:40.864481 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 03 15:02:40.864481 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 15:02:40.864481 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 15:02:40.864481 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 03 15:02:40.864481 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 03 15:02:40.864481 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 15:02:40.864481 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 15:02:40.864481 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 03 15:02:40.864481 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 03 15:02:40.864481 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 03 15:02:40.864481 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 03 15:02:40.864481 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 03 15:02:40.864481 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 03 15:02:40.864481 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 15:02:40.864481 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 15:02:40.864481 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 15:02:40.865976 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 15:02:40.865976 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 15:02:40.865976 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 15:02:40.865976 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 15:02:40.865976 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 15:02:40.865976 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f4130d69-e079-4679-a2bd-e2d7d6c707be could not be found. Oct 03 15:02:40.865976 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:40.865976 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:40.865976 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:40.865976 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:40.865976 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:40.865976 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:40.865976 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:02:40.865976 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:02:40.865976 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 15:02:40.865976 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 15:02:40.865976 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:02:40.865976 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:02:40.865976 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 03 15:02:40.865976 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:02:40.867503 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f4130d69-e079-4679-a2bd-e2d7d6c707be could not be found. Oct 03 15:02:40.867503 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:40.867503 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:40.867503 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:40.867503 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:40.867503 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:40.867503 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:40.867503 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:02:40.867503 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:02:40.867503 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f4130d69-e079-4679-a2bd-e2d7d6c707be could not be found. Oct 03 15:02:40.867503 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:40.867503 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-c262a322-a70f-4b0d-8a99-d77f99d10d1a tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] Returning 404 to user: Snapshot f4130d69-e079-4679-a2bd-e2d7d6c707be could not be found. {{(pid=126851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:02:40.867503 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-c262a322-a70f-4b0d-8a99-d77f99d10d1a tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/f4130d69-e079-4679-a2bd-e2d7d6c707be" status: 404 len: 111 microversion: 2.1 time: 0.034378 Oct 03 15:02:40.868498 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 536/1034] 10.222.0.46 () {58 vars in 1251 bytes} [Mon Oct 3 15:02:40 2022] GET /compute/v2.1/os-snapshots/f4130d69-e079-4679-a2bd-e2d7d6c707be => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:02:40.870146 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-e2745bd0-c34d-41b0-9d75-bbe2d68999f9 tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] Calling method '.version_select at 0x7fe0d3581a60>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:40.932597 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-e2745bd0-c34d-41b0-9d75-bbe2d68999f9 tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05" status: 202 len: 0 microversion: 2.1 time: 0.066075 Oct 03 15:02:40.933419 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 499/1035] 10.222.0.46 () {58 vars in 1248 bytes} [Mon Oct 3 15:02:40 2022] DELETE /compute/v2.1/os-volumes/eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:02:40.942342 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-56b3de0e-fce0-4cc4-a197-3353027f9cb7 tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] Calling method '.version_select at 0x7fe0d3504dc0>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:40.991419 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-56b3de0e-fce0-4cc4-a197-3353027f9cb7 tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05" status: 200 len: 345 microversion: 2.1 time: 0.052962 Oct 03 15:02:40.991989 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 537/1036] 10.222.0.46 () {58 vars in 1245 bytes} [Mon Oct 3 15:02:40 2022] GET /compute/v2.1/os-volumes/eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:02:41.642718 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-8904b610-7943-4eba-84bc-9fc9389af087 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:41.644435 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-8904b610-7943-4eba-84bc-9fc9389af087 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:41.651370 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8904b610-7943-4eba-84bc-9fc9389af087 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:41.652072 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8904b610-7943-4eba-84bc-9fc9389af087 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:41.652728 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8904b610-7943-4eba-84bc-9fc9389af087 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:41.653631 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8904b610-7943-4eba-84bc-9fc9389af087 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:41.654324 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8904b610-7943-4eba-84bc-9fc9389af087 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:41.654753 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8904b610-7943-4eba-84bc-9fc9389af087 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:41.728893 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-8904b610-7943-4eba-84bc-9fc9389af087 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:02:41.738309 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-8904b610-7943-4eba-84bc-9fc9389af087 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:02:41.739917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-8904b610-7943-4eba-84bc-9fc9389af087 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e5325f010ae4359bd6b514a1995614d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f48b2441eec48c4ac784844e475a9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:02:41.741815 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-8904b610-7943-4eba-84bc-9fc9389af087 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 200 len: 1655 microversion: 2.20 time: 0.103327 Oct 03 15:02:41.742563 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 500/1037] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:02:41 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 1655 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 15:02:41.966113 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-50186eba-b9e2-4924-a61c-5f94433e37e8 req-50227772-180c-4502-aab1-cbafb21951d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "492aa42e-764b-4444-b4aa-c0ff2a4202d9", "name": "network-vif-deleted", "tag": "cfdafec3-b426-4742-8d49-c455e689f120"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:02:41.992518 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-50186eba-b9e2-4924-a61c-5f94433e37e8 req-50227772-180c-4502-aab1-cbafb21951d9 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:41.993019 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-50186eba-b9e2-4924-a61c-5f94433e37e8 req-50227772-180c-4502-aab1-cbafb21951d9 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:41.993572 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-50186eba-b9e2-4924-a61c-5f94433e37e8 req-50227772-180c-4502-aab1-cbafb21951d9 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:42.010869 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-4d7e68aa-b24e-4982-88de-efac148806c8 tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] Calling method '.version_select at 0x7fe0d336dd30>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:42.065196 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.wsgi [None req-4d7e68aa-b24e-4982-88de-efac148806c8 tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] HTTP exception thrown: Volume eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05 could not be found. Oct 03 15:02:42.083853 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-50186eba-b9e2-4924-a61c-5f94433e37e8 req-50227772-180c-4502-aab1-cbafb21951d9 service nova] Creating event network-vif-deleted:cfdafec3-b426-4742-8d49-c455e689f120 for instance 492aa42e-764b-4444-b4aa-c0ff2a4202d9 on hv-cinder-85987 Oct 03 15:02:42.085883 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-4d7e68aa-b24e-4982-88de-efac148806c8 tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] Request method failure captured: Oct 03 15:02:42.085883 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: request: GET /compute/v2.1/os-volumes/eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05 HTTP/1.1 Oct 03 15:02:42.085883 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept: application/json Oct 03 15:02:42.085883 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept-Encoding: identity Oct 03 15:02:42.085883 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Connection: close Oct 03 15:02:42.085883 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Length: 0 Oct 03 15:02:42.085883 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Type: application/json Oct 03 15:02:42.085883 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Host: 10.222.0.46 Oct 03 15:02:42.085883 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Openstack-System-Scope: None Oct 03 15:02:42.085883 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: User-Agent: python-urllib3/1.26.12 Oct 03 15:02:42.085883 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Auth-Token: gAAAAABjOvmI_TKRilBagY79txXcsD7ziiBMh5XcJc8efmxA80h0dDYOe07jxgNaB4abelXCGzZ3ELkuDnaIY1gqjvFzolBUAJTFsBjDc75sC0kHH1aqU5m__x8XRtevytajV_zCn3-CMAeghz4vhgwYpkqFXoXElTxRxU9JR8jH2Ak6yET4eYA Oct 03 15:02:42.085883 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Id: None Oct 03 15:02:42.085883 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Name: None Oct 03 15:02:42.085883 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Identity-Status: Confirmed Oct 03 15:02:42.085883 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Is-Admin-Project: True Oct 03 15:02:42.085883 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Id: default Oct 03 15:02:42.085883 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Name: Default Oct 03 15:02:42.085883 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Id: 8203ec601e074484b26de4380c9c9257 Oct 03 15:02:42.085883 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1298734599 Oct 03 15:02:42.085883 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Role: member,reader Oct 03 15:02:42.085883 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Roles: member,reader Oct 03 15:02:42.087246 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8203ec601e074484b26de4380c9c9257"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8203ec601e074484b26de4380c9c9257"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8203ec601e074484b26de4380c9c9257"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8203ec601e074484b26de4380c9c9257"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 15:02:42.087246 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1298734599 Oct 03 15:02:42.087246 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Id: 8203ec601e074484b26de4380c9c9257 Oct 03 15:02:42.087246 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1298734599 Oct 03 15:02:42.087246 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User: tempest-VolumesSnapshotsTestJSON-1298734599-project Oct 03 15:02:42.087246 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Id: default Oct 03 15:02:42.087246 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Name: Default Oct 03 15:02:42.087246 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Id: 9d36c4b97e6b4df780ee04bc02981a30 Oct 03 15:02:42.087246 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1298734599-project Oct 03 15:02:42.087246 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: method: Oct 03 15:02:42.087246 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: exception: Volume eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05 could not be found. Oct 03 15:02:42.087246 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: action_args: {'id': 'eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05'} Oct 03 15:02:42.087246 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:02:42.088070 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:42.088070 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 15:02:42.088070 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 15:02:42.088070 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 15:02:42.088070 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 15:02:42.088070 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 15:02:42.088070 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 15:02:42.088070 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 15:02:42.088070 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 15:02:42.088070 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 15:02:42.088070 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 15:02:42.088070 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 15:02:42.088070 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 15:02:42.088070 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 15:02:42.088070 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 15:02:42.088070 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05 could not be found. (HTTP 404) (Request-ID: req-df34a4eb-f1b1-40ac-95ea-5ffe5ac195b7) Oct 03 15:02:42.088070 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:42.088070 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:42.088070 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:42.089251 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:42.089251 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 03 15:02:42.089251 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 03 15:02:42.089251 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 15:02:42.089251 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 15:02:42.089251 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 15:02:42.089251 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 15:02:42.089251 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 15:02:42.089251 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 15:02:42.089251 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 15:02:42.089251 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 15:02:42.089251 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 15:02:42.089251 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 15:02:42.089251 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 15:02:42.089251 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 15:02:42.089251 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 15:02:42.089251 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 15:02:42.089251 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 15:02:42.089251 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 15:02:42.090961 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 15:02:42.090961 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 15:02:42.090961 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 15:02:42.090961 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 15:02:42.090961 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05 could not be found. Oct 03 15:02:42.090961 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:42.090961 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:42.090961 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:42.090961 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:42.090961 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:42.090961 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:42.090961 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:02:42.090961 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:02:42.090961 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 15:02:42.090961 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 15:02:42.090961 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:02:42.090961 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:02:42.090961 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 03 15:02:42.090961 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:02:42.092391 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05 could not be found. Oct 03 15:02:42.092391 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:42.092391 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:42.092391 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:42.092391 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:42.092391 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:42.092391 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:42.092391 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:02:42.092391 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:02:42.092391 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05 could not be found. Oct 03 15:02:42.092391 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:42.093252 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-50186eba-b9e2-4924-a61c-5f94433e37e8 req-50227772-180c-4502-aab1-cbafb21951d9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132946 Oct 03 15:02:42.093252 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 538/1038] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 15:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:02:42.096409 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-4d7e68aa-b24e-4982-88de-efac148806c8 tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] Returning 404 to user: Volume eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05 could not be found. {{(pid=126852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:02:42.098699 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-4d7e68aa-b24e-4982-88de-efac148806c8 tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05" status: 404 len: 109 microversion: 2.1 time: 0.092364 Oct 03 15:02:42.103329 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 501/1039] 10.222.0.46 () {58 vars in 1245 bytes} [Mon Oct 3 15:02:42 2022] GET /compute/v2.1/os-volumes/eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05 => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:02:42.130921 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-97cebcfc-77a0-499a-b88a-03d2777d16ce tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] Calling method '.version_select at 0x7fe0d6c84b80>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:42.167724 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.wsgi [None req-97cebcfc-77a0-499a-b88a-03d2777d16ce tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] HTTP exception thrown: Volume eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05 could not be found. Oct 03 15:02:42.169836 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-97cebcfc-77a0-499a-b88a-03d2777d16ce tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] Request method failure captured: Oct 03 15:02:42.169836 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: request: DELETE /compute/v2.1/os-volumes/eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05 HTTP/1.1 Oct 03 15:02:42.169836 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept: application/json Oct 03 15:02:42.169836 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept-Encoding: identity Oct 03 15:02:42.169836 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Connection: close Oct 03 15:02:42.169836 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Length: 0 Oct 03 15:02:42.169836 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Type: application/json Oct 03 15:02:42.169836 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Host: 10.222.0.46 Oct 03 15:02:42.169836 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Openstack-System-Scope: None Oct 03 15:02:42.169836 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: User-Agent: python-urllib3/1.26.12 Oct 03 15:02:42.169836 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Auth-Token: gAAAAABjOvmI_TKRilBagY79txXcsD7ziiBMh5XcJc8efmxA80h0dDYOe07jxgNaB4abelXCGzZ3ELkuDnaIY1gqjvFzolBUAJTFsBjDc75sC0kHH1aqU5m__x8XRtevytajV_zCn3-CMAeghz4vhgwYpkqFXoXElTxRxU9JR8jH2Ak6yET4eYA Oct 03 15:02:42.169836 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Id: None Oct 03 15:02:42.169836 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Name: None Oct 03 15:02:42.169836 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Identity-Status: Confirmed Oct 03 15:02:42.169836 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Is-Admin-Project: True Oct 03 15:02:42.169836 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Id: default Oct 03 15:02:42.169836 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Name: Default Oct 03 15:02:42.169836 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Id: 8203ec601e074484b26de4380c9c9257 Oct 03 15:02:42.169836 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1298734599 Oct 03 15:02:42.169836 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Role: member,reader Oct 03 15:02:42.169836 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Roles: member,reader Oct 03 15:02:42.171746 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8203ec601e074484b26de4380c9c9257"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8203ec601e074484b26de4380c9c9257"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8203ec601e074484b26de4380c9c9257"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8203ec601e074484b26de4380c9c9257"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 15:02:42.171746 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1298734599 Oct 03 15:02:42.171746 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Id: 8203ec601e074484b26de4380c9c9257 Oct 03 15:02:42.171746 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1298734599 Oct 03 15:02:42.171746 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User: tempest-VolumesSnapshotsTestJSON-1298734599-project Oct 03 15:02:42.171746 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Id: default Oct 03 15:02:42.171746 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Name: Default Oct 03 15:02:42.171746 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Id: 9d36c4b97e6b4df780ee04bc02981a30 Oct 03 15:02:42.171746 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1298734599-project Oct 03 15:02:42.171746 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: method: Oct 03 15:02:42.171746 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: exception: Volume eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05 could not be found. Oct 03 15:02:42.171746 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: action_args: {'id': 'eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05'} Oct 03 15:02:42.171746 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:02:42.172574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:42.172574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 15:02:42.172574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 15:02:42.172574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 03 15:02:42.172574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 03 15:02:42.172574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 03 15:02:42.172574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 03 15:02:42.172574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 03 15:02:42.172574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 03 15:02:42.172574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 03 15:02:42.172574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 03 15:02:42.172574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 15:02:42.172574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 15:02:42.172574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 15:02:42.172574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 15:02:42.172574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05 could not be found. (HTTP 404) (Request-ID: req-8a956de5-64c9-431c-9ac9-de2b01a632ae) Oct 03 15:02:42.172574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:42.172574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:42.172574 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:42.173807 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:42.173807 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 03 15:02:42.173807 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 03 15:02:42.173807 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 15:02:42.173807 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 15:02:42.173807 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 15:02:42.173807 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 15:02:42.173807 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 15:02:42.173807 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 15:02:42.173807 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 15:02:42.173807 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 15:02:42.173807 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 03 15:02:42.173807 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 03 15:02:42.173807 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 03 15:02:42.173807 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 03 15:02:42.173807 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 03 15:02:42.173807 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 03 15:02:42.173807 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 03 15:02:42.173807 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 03 15:02:42.175084 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 15:02:42.175084 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 15:02:42.175084 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 15:02:42.175084 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 15:02:42.175084 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05 could not be found. Oct 03 15:02:42.175084 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:42.175084 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:42.175084 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:42.175084 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:42.175084 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:42.175084 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:42.175084 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:02:42.175084 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:02:42.175084 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 15:02:42.175084 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 15:02:42.175084 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:02:42.175084 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:02:42.175084 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 03 15:02:42.175084 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:02:42.176344 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05 could not be found. Oct 03 15:02:42.176344 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:42.176344 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:42.176344 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:42.176344 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:42.176344 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:42.176344 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:42.176344 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:02:42.176344 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:02:42.176344 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05 could not be found. Oct 03 15:02:42.176344 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:42.176344 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-97cebcfc-77a0-499a-b88a-03d2777d16ce tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] Returning 404 to user: Volume eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05 could not be found. {{(pid=126851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:02:42.176344 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-97cebcfc-77a0-499a-b88a-03d2777d16ce tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05" status: 404 len: 109 microversion: 2.1 time: 0.057543 Oct 03 15:02:42.177137 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 539/1040] 10.222.0.46 () {58 vars in 1248 bytes} [Mon Oct 3 15:02:42 2022] DELETE /compute/v2.1/os-volumes/eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:02:42.182111 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-8a5ab5aa-28cb-4f04-89df-0bbbf3cac72b tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] Calling method '.version_select at 0x7fe0d359adc0>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:42.222758 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.wsgi [None req-8a5ab5aa-28cb-4f04-89df-0bbbf3cac72b tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] HTTP exception thrown: Volume eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05 could not be found. Oct 03 15:02:42.226991 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-8a5ab5aa-28cb-4f04-89df-0bbbf3cac72b tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] Request method failure captured: Oct 03 15:02:42.226991 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: request: GET /compute/v2.1/os-volumes/eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05 HTTP/1.1 Oct 03 15:02:42.226991 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept: application/json Oct 03 15:02:42.226991 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept-Encoding: identity Oct 03 15:02:42.226991 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Connection: close Oct 03 15:02:42.226991 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Length: 0 Oct 03 15:02:42.226991 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Type: application/json Oct 03 15:02:42.226991 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Host: 10.222.0.46 Oct 03 15:02:42.226991 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Openstack-System-Scope: None Oct 03 15:02:42.226991 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: User-Agent: python-urllib3/1.26.12 Oct 03 15:02:42.226991 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Auth-Token: gAAAAABjOvmI_TKRilBagY79txXcsD7ziiBMh5XcJc8efmxA80h0dDYOe07jxgNaB4abelXCGzZ3ELkuDnaIY1gqjvFzolBUAJTFsBjDc75sC0kHH1aqU5m__x8XRtevytajV_zCn3-CMAeghz4vhgwYpkqFXoXElTxRxU9JR8jH2Ak6yET4eYA Oct 03 15:02:42.226991 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Id: None Oct 03 15:02:42.226991 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Name: None Oct 03 15:02:42.226991 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Identity-Status: Confirmed Oct 03 15:02:42.226991 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Is-Admin-Project: True Oct 03 15:02:42.226991 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Id: default Oct 03 15:02:42.226991 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Name: Default Oct 03 15:02:42.226991 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Id: 8203ec601e074484b26de4380c9c9257 Oct 03 15:02:42.226991 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1298734599 Oct 03 15:02:42.226991 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Role: member,reader Oct 03 15:02:42.226991 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Roles: member,reader Oct 03 15:02:42.228717 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8203ec601e074484b26de4380c9c9257"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8203ec601e074484b26de4380c9c9257"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8203ec601e074484b26de4380c9c9257"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8203ec601e074484b26de4380c9c9257"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 15:02:42.228717 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1298734599 Oct 03 15:02:42.228717 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Id: 8203ec601e074484b26de4380c9c9257 Oct 03 15:02:42.228717 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1298734599 Oct 03 15:02:42.228717 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User: tempest-VolumesSnapshotsTestJSON-1298734599-project Oct 03 15:02:42.228717 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Id: default Oct 03 15:02:42.228717 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Name: Default Oct 03 15:02:42.228717 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Id: 9d36c4b97e6b4df780ee04bc02981a30 Oct 03 15:02:42.228717 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1298734599-project Oct 03 15:02:42.228717 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: method: Oct 03 15:02:42.228717 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: exception: Volume eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05 could not be found. Oct 03 15:02:42.228717 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: action_args: {'id': 'eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05'} Oct 03 15:02:42.228717 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:02:42.229737 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:42.229737 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 15:02:42.229737 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 15:02:42.229737 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 15:02:42.229737 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 15:02:42.229737 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 15:02:42.229737 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 15:02:42.229737 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 15:02:42.229737 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 15:02:42.229737 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 15:02:42.229737 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 15:02:42.229737 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 15:02:42.229737 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 15:02:42.229737 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 15:02:42.229737 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 15:02:42.229737 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05 could not be found. (HTTP 404) (Request-ID: req-f5af3ec4-3900-4a08-ad66-b3fff0e0c3a2) Oct 03 15:02:42.229737 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:42.229737 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:42.229737 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:42.236335 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:42.236335 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 03 15:02:42.236335 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 03 15:02:42.236335 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 15:02:42.236335 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 15:02:42.236335 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 15:02:42.236335 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 15:02:42.236335 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 15:02:42.236335 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 15:02:42.236335 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 15:02:42.236335 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 15:02:42.236335 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 15:02:42.236335 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 15:02:42.236335 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 15:02:42.236335 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 15:02:42.236335 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 15:02:42.236335 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 15:02:42.236335 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 15:02:42.236335 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 15:02:42.238020 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 15:02:42.238020 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 15:02:42.238020 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 15:02:42.238020 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 15:02:42.238020 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05 could not be found. Oct 03 15:02:42.238020 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:42.238020 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:42.238020 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:42.238020 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:42.238020 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:42.238020 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:42.238020 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:02:42.238020 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:02:42.238020 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 15:02:42.238020 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 15:02:42.238020 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:02:42.238020 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:02:42.238020 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 03 15:02:42.238020 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:02:42.239701 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05 could not be found. Oct 03 15:02:42.239701 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:42.239701 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:42.239701 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:42.239701 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:42.239701 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:42.239701 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:42.239701 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:02:42.239701 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:02:42.239701 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05 could not be found. Oct 03 15:02:42.239701 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:42.239701 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-8a5ab5aa-28cb-4f04-89df-0bbbf3cac72b tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] Returning 404 to user: Volume eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05 could not be found. {{(pid=126852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:02:42.239701 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-8a5ab5aa-28cb-4f04-89df-0bbbf3cac72b tempest-VolumesSnapshotsTestJSON-1298734599 tempest-VolumesSnapshotsTestJSON-1298734599-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05" status: 404 len: 109 microversion: 2.1 time: 0.052282 Oct 03 15:02:42.239701 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 502/1041] 10.222.0.46 () {58 vars in 1245 bytes} [Mon Oct 3 15:02:42 2022] GET /compute/v2.1/os-volumes/eb01ed87-fdbd-4c3e-8246-43f0d2ad6f05 => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:02:42.768219 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-c3897a41-7766-4a4f-aeb1-ac03eb86ac76 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:42.769567 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-c3897a41-7766-4a4f-aeb1-ac03eb86ac76 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:42.782780 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c3897a41-7766-4a4f-aeb1-ac03eb86ac76 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:42.783582 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c3897a41-7766-4a4f-aeb1-ac03eb86ac76 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:42.784643 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c3897a41-7766-4a4f-aeb1-ac03eb86ac76 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:42.785548 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c3897a41-7766-4a4f-aeb1-ac03eb86ac76 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:42.786074 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c3897a41-7766-4a4f-aeb1-ac03eb86ac76 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:42.786578 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c3897a41-7766-4a4f-aeb1-ac03eb86ac76 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:42.803807 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.wsgi [None req-c3897a41-7766-4a4f-aeb1-ac03eb86ac76 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] HTTP exception thrown: Instance 492aa42e-764b-4444-b4aa-c0ff2a4202d9 could not be found. Oct 03 15:02:42.806230 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-c3897a41-7766-4a4f-aeb1-ac03eb86ac76 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Request method failure captured: Oct 03 15:02:42.806230 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: request: GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 HTTP/1.1 Oct 03 15:02:42.806230 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept: application/json Oct 03 15:02:42.806230 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept-Encoding: identity Oct 03 15:02:42.806230 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Connection: close Oct 03 15:02:42.806230 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Length: 0 Oct 03 15:02:42.806230 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Type: application/json Oct 03 15:02:42.806230 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Host: 10.222.0.46 Oct 03 15:02:42.806230 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Openstack-System-Scope: None Oct 03 15:02:42.806230 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: User-Agent: python-urllib3/1.26.12 Oct 03 15:02:42.806230 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Auth-Token: gAAAAABjOvcaThjSXmST5Zui92tHpMFw7Oxu-LFHnLknGWdFg73n571Y94smvW3XiTCJONsYXW31rAR_Uk3b29zBX0vJUsq5e-sWUiw8SznibgFubZYgKjvRE5b1DEDp_CtTDUUHWp1Zy_ofQJQKHoqdksglIT7DpAg5H98Wcz58Zuh9fuXxiw4 Oct 03 15:02:42.806230 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Id: None Oct 03 15:02:42.806230 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Name: None Oct 03 15:02:42.806230 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Identity-Status: Confirmed Oct 03 15:02:42.806230 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Is-Admin-Project: True Oct 03 15:02:42.806230 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Openstack-Nova-Api-Version: 2.20 Oct 03 15:02:42.806230 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Id: default Oct 03 15:02:42.806230 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Name: Default Oct 03 15:02:42.806230 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Id: 7f48b2441eec48c4ac784844e475a9e9 Oct 03 15:02:42.806230 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-558801479 Oct 03 15:02:42.806230 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Role: member,reader Oct 03 15:02:42.806230 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Roles: member,reader Oct 03 15:02:42.808126 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7f48b2441eec48c4ac784844e475a9e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7f48b2441eec48c4ac784844e475a9e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7f48b2441eec48c4ac784844e475a9e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7f48b2441eec48c4ac784844e475a9e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 15:02:42.808126 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant: tempest-AttachVolumeShelveTestJSON-558801479 Oct 03 15:02:42.808126 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Id: 7f48b2441eec48c4ac784844e475a9e9 Oct 03 15:02:42.808126 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-558801479 Oct 03 15:02:42.808126 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User: tempest-AttachVolumeShelveTestJSON-558801479-project Oct 03 15:02:42.808126 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Id: default Oct 03 15:02:42.808126 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Name: Default Oct 03 15:02:42.808126 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Id: 9e5325f010ae4359bd6b514a1995614d Oct 03 15:02:42.808126 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Name: tempest-AttachVolumeShelveTestJSON-558801479-project Oct 03 15:02:42.808126 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: method: > Oct 03 15:02:42.808126 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: exception: Instance 492aa42e-764b-4444-b4aa-c0ff2a4202d9 could not be found. Oct 03 15:02:42.808126 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: action_args: {'id': '492aa42e-764b-4444-b4aa-c0ff2a4202d9'} Oct 03 15:02:42.809445 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:02:42.809445 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:42.809445 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:02:42.809445 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:02:42.809445 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:02:42.809445 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:02:42.809445 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:02:42.809445 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:02:42.809445 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:02:42.809445 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:02:42.809445 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 492aa42e-764b-4444-b4aa-c0ff2a4202d9 could not be found. Oct 03 15:02:42.809445 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:42.809445 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:42.809445 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:42.809445 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:42.809445 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:42.809445 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:42.809445 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:02:42.809445 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:02:42.809445 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:02:42.811042 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:02:42.811042 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:02:42.811042 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:02:42.811042 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:02:42.811042 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:02:42.811042 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:02:42.811042 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:02:42.811042 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 492aa42e-764b-4444-b4aa-c0ff2a4202d9 could not be found. Oct 03 15:02:42.811042 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:42.811042 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:42.811042 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:42.811042 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:42.811042 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:42.811042 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:42.811042 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:02:42.811042 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:02:42.811042 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 492aa42e-764b-4444-b4aa-c0ff2a4202d9 could not be found. Oct 03 15:02:42.811042 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:42.812313 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-c3897a41-7766-4a4f-aeb1-ac03eb86ac76 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Returning 404 to user: Instance 492aa42e-764b-4444-b4aa-c0ff2a4202d9 could not be found. {{(pid=126851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:02:42.812313 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-c3897a41-7766-4a4f-aeb1-ac03eb86ac76 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 404 len: 111 microversion: 2.20 time: 0.044183 Oct 03 15:02:42.814329 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 540/1042] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:02:42 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 15:02:42.824466 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-af0665e7-a8ad-4441-9f5a-a12551eb0b35 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '.version_select at 0x7fe0d336dc10>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:42.856015 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-af0665e7-a8ad-4441-9f5a-a12551eb0b35 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-572081692" status: 204 len: 0 microversion: 2.20 time: 0.039205 Oct 03 15:02:42.857061 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 503/1043] 10.222.0.46 () {60 vars in 1259 bytes} [Mon Oct 3 15:02:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-572081692 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 15:02:44.738258 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-6546bee8-a27f-49a1-9b39-c1c5d52abbe6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:44.738740 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-6546bee8-a27f-49a1-9b39-c1c5d52abbe6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:44.745320 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6546bee8-a27f-49a1-9b39-c1c5d52abbe6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:44.745831 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6546bee8-a27f-49a1-9b39-c1c5d52abbe6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:44.746264 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6546bee8-a27f-49a1-9b39-c1c5d52abbe6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:44.746966 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6546bee8-a27f-49a1-9b39-c1c5d52abbe6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:44.747415 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6546bee8-a27f-49a1-9b39-c1c5d52abbe6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:44.748134 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6546bee8-a27f-49a1-9b39-c1c5d52abbe6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:44.762824 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.wsgi [None req-6546bee8-a27f-49a1-9b39-c1c5d52abbe6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] HTTP exception thrown: Instance 492aa42e-764b-4444-b4aa-c0ff2a4202d9 could not be found. Oct 03 15:02:44.764363 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-6546bee8-a27f-49a1-9b39-c1c5d52abbe6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Request method failure captured: Oct 03 15:02:44.764363 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: request: DELETE /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 HTTP/1.1 Oct 03 15:02:44.764363 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept: application/json Oct 03 15:02:44.764363 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept-Encoding: identity Oct 03 15:02:44.764363 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Connection: close Oct 03 15:02:44.764363 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Length: 0 Oct 03 15:02:44.764363 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Type: application/json Oct 03 15:02:44.764363 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Host: 10.222.0.46 Oct 03 15:02:44.764363 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Openstack-System-Scope: None Oct 03 15:02:44.764363 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: User-Agent: python-urllib3/1.26.12 Oct 03 15:02:44.764363 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Auth-Token: gAAAAABjOvcaThjSXmST5Zui92tHpMFw7Oxu-LFHnLknGWdFg73n571Y94smvW3XiTCJONsYXW31rAR_Uk3b29zBX0vJUsq5e-sWUiw8SznibgFubZYgKjvRE5b1DEDp_CtTDUUHWp1Zy_ofQJQKHoqdksglIT7DpAg5H98Wcz58Zuh9fuXxiw4 Oct 03 15:02:44.764363 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Id: None Oct 03 15:02:44.764363 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Name: None Oct 03 15:02:44.764363 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Identity-Status: Confirmed Oct 03 15:02:44.764363 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Is-Admin-Project: True Oct 03 15:02:44.764363 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Openstack-Nova-Api-Version: 2.20 Oct 03 15:02:44.764363 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Id: default Oct 03 15:02:44.764363 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Name: Default Oct 03 15:02:44.764363 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Id: 7f48b2441eec48c4ac784844e475a9e9 Oct 03 15:02:44.764363 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-558801479 Oct 03 15:02:44.764363 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Role: member,reader Oct 03 15:02:44.764363 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Roles: member,reader Oct 03 15:02:44.766431 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7f48b2441eec48c4ac784844e475a9e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7f48b2441eec48c4ac784844e475a9e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7f48b2441eec48c4ac784844e475a9e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7f48b2441eec48c4ac784844e475a9e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 15:02:44.766431 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant: tempest-AttachVolumeShelveTestJSON-558801479 Oct 03 15:02:44.766431 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Id: 7f48b2441eec48c4ac784844e475a9e9 Oct 03 15:02:44.766431 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-558801479 Oct 03 15:02:44.766431 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User: tempest-AttachVolumeShelveTestJSON-558801479-project Oct 03 15:02:44.766431 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Id: default Oct 03 15:02:44.766431 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Name: Default Oct 03 15:02:44.766431 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Id: 9e5325f010ae4359bd6b514a1995614d Oct 03 15:02:44.766431 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Name: tempest-AttachVolumeShelveTestJSON-558801479-project Oct 03 15:02:44.766431 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: method: > Oct 03 15:02:44.766431 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: exception: Instance 492aa42e-764b-4444-b4aa-c0ff2a4202d9 could not be found. Oct 03 15:02:44.766431 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: action_args: {'id': '492aa42e-764b-4444-b4aa-c0ff2a4202d9'} Oct 03 15:02:44.767203 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:02:44.767203 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:44.767203 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:02:44.767203 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:02:44.767203 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:02:44.767203 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:02:44.767203 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:02:44.767203 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:02:44.767203 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:02:44.767203 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:02:44.767203 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 492aa42e-764b-4444-b4aa-c0ff2a4202d9 could not be found. Oct 03 15:02:44.767203 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:44.767203 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:44.767203 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:44.767203 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:44.767203 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:44.767203 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:44.767203 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:02:44.767203 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:02:44.767203 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:02:44.768525 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:02:44.768525 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 15:02:44.768525 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 15:02:44.768525 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 15:02:44.768525 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 15:02:44.768525 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:02:44.768525 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:02:44.768525 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:02:44.768525 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:02:44.768525 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 492aa42e-764b-4444-b4aa-c0ff2a4202d9 could not be found. Oct 03 15:02:44.768525 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:44.768525 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:44.768525 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:44.768525 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:44.768525 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:44.768525 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:44.768525 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:02:44.768525 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:02:44.768525 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 492aa42e-764b-4444-b4aa-c0ff2a4202d9 could not be found. Oct 03 15:02:44.768525 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:44.769804 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-6546bee8-a27f-49a1-9b39-c1c5d52abbe6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Returning 404 to user: Instance 492aa42e-764b-4444-b4aa-c0ff2a4202d9 could not be found. {{(pid=126851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:02:44.769804 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-6546bee8-a27f-49a1-9b39-c1c5d52abbe6 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "DELETE /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 404 len: 111 microversion: 2.20 time: 0.032169 Oct 03 15:02:44.769804 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 541/1044] 10.222.0.46 () {60 vars in 1280 bytes} [Mon Oct 3 15:02:44 2022] DELETE /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 15:02:44.775712 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-555398ce-0687-47d3-a766-1495793ac057 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:44.776270 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-555398ce-0687-47d3-a766-1495793ac057 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 492aa42e-764b-4444-b4aa-c0ff2a4202d9] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:44.783136 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-555398ce-0687-47d3-a766-1495793ac057 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:44.783629 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-555398ce-0687-47d3-a766-1495793ac057 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:44.784068 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-555398ce-0687-47d3-a766-1495793ac057 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:44.784762 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-555398ce-0687-47d3-a766-1495793ac057 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:44.785402 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-555398ce-0687-47d3-a766-1495793ac057 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:44.785856 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-555398ce-0687-47d3-a766-1495793ac057 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:44.800832 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.wsgi [None req-555398ce-0687-47d3-a766-1495793ac057 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] HTTP exception thrown: Instance 492aa42e-764b-4444-b4aa-c0ff2a4202d9 could not be found. Oct 03 15:02:44.802474 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-555398ce-0687-47d3-a766-1495793ac057 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Request method failure captured: Oct 03 15:02:44.802474 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: request: GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 HTTP/1.1 Oct 03 15:02:44.802474 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept: application/json Oct 03 15:02:44.802474 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept-Encoding: identity Oct 03 15:02:44.802474 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Connection: close Oct 03 15:02:44.802474 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Length: 0 Oct 03 15:02:44.802474 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Type: application/json Oct 03 15:02:44.802474 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Host: 10.222.0.46 Oct 03 15:02:44.802474 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Openstack-System-Scope: None Oct 03 15:02:44.802474 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: User-Agent: python-urllib3/1.26.12 Oct 03 15:02:44.802474 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Auth-Token: gAAAAABjOvcaThjSXmST5Zui92tHpMFw7Oxu-LFHnLknGWdFg73n571Y94smvW3XiTCJONsYXW31rAR_Uk3b29zBX0vJUsq5e-sWUiw8SznibgFubZYgKjvRE5b1DEDp_CtTDUUHWp1Zy_ofQJQKHoqdksglIT7DpAg5H98Wcz58Zuh9fuXxiw4 Oct 03 15:02:44.802474 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Id: None Oct 03 15:02:44.802474 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Name: None Oct 03 15:02:44.802474 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Identity-Status: Confirmed Oct 03 15:02:44.802474 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Is-Admin-Project: True Oct 03 15:02:44.802474 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Openstack-Nova-Api-Version: 2.20 Oct 03 15:02:44.802474 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Id: default Oct 03 15:02:44.802474 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Name: Default Oct 03 15:02:44.802474 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Id: 7f48b2441eec48c4ac784844e475a9e9 Oct 03 15:02:44.802474 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-558801479 Oct 03 15:02:44.802474 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Role: member,reader Oct 03 15:02:44.802474 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Roles: member,reader Oct 03 15:02:44.804290 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7f48b2441eec48c4ac784844e475a9e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7f48b2441eec48c4ac784844e475a9e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7f48b2441eec48c4ac784844e475a9e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7f48b2441eec48c4ac784844e475a9e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 15:02:44.804290 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant: tempest-AttachVolumeShelveTestJSON-558801479 Oct 03 15:02:44.804290 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Id: 7f48b2441eec48c4ac784844e475a9e9 Oct 03 15:02:44.804290 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-558801479 Oct 03 15:02:44.804290 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User: tempest-AttachVolumeShelveTestJSON-558801479-project Oct 03 15:02:44.804290 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Id: default Oct 03 15:02:44.804290 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Name: Default Oct 03 15:02:44.804290 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Id: 9e5325f010ae4359bd6b514a1995614d Oct 03 15:02:44.804290 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Name: tempest-AttachVolumeShelveTestJSON-558801479-project Oct 03 15:02:44.804290 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: method: > Oct 03 15:02:44.804290 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: exception: Instance 492aa42e-764b-4444-b4aa-c0ff2a4202d9 could not be found. Oct 03 15:02:44.804290 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: action_args: {'id': '492aa42e-764b-4444-b4aa-c0ff2a4202d9'} Oct 03 15:02:44.808414 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:02:44.808414 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:44.808414 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:02:44.808414 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:02:44.808414 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:02:44.808414 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:02:44.808414 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:02:44.808414 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:02:44.808414 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:02:44.808414 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:02:44.808414 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 492aa42e-764b-4444-b4aa-c0ff2a4202d9 could not be found. Oct 03 15:02:44.808414 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:44.808414 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:44.808414 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:44.808414 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:44.808414 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:44.808414 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:44.808414 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:02:44.808414 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:02:44.808414 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:02:44.810156 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:02:44.810156 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:02:44.810156 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:02:44.810156 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:02:44.810156 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:02:44.810156 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:02:44.810156 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:02:44.810156 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 492aa42e-764b-4444-b4aa-c0ff2a4202d9 could not be found. Oct 03 15:02:44.810156 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:44.810156 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:44.810156 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:44.810156 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:44.810156 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:44.810156 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:44.810156 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:02:44.810156 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:02:44.810156 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 492aa42e-764b-4444-b4aa-c0ff2a4202d9 could not be found. Oct 03 15:02:44.810156 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:44.812379 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-555398ce-0687-47d3-a766-1495793ac057 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Returning 404 to user: Instance 492aa42e-764b-4444-b4aa-c0ff2a4202d9 could not be found. {{(pid=126852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:02:44.812379 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-555398ce-0687-47d3-a766-1495793ac057 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9" status: 404 len: 111 microversion: 2.20 time: 0.033129 Oct 03 15:02:44.812379 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 504/1045] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:02:44 2022] GET /compute/v2.1/servers/492aa42e-764b-4444-b4aa-c0ff2a4202d9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 15:02:45.954705 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-196e156b-6802-4d5a-9d87-7199890de23f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:45.955977 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-196e156b-6802-4d5a-9d87-7199890de23f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:45.964436 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-196e156b-6802-4d5a-9d87-7199890de23f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:45.965010 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-196e156b-6802-4d5a-9d87-7199890de23f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:45.965458 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-196e156b-6802-4d5a-9d87-7199890de23f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:45.966417 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-196e156b-6802-4d5a-9d87-7199890de23f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:45.967076 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-196e156b-6802-4d5a-9d87-7199890de23f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:45.967677 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-196e156b-6802-4d5a-9d87-7199890de23f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:45.984561 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.wsgi [None req-196e156b-6802-4d5a-9d87-7199890de23f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] HTTP exception thrown: Instance 27879d6c-62f5-4281-b134-faecf706a2db could not be found. Oct 03 15:02:45.986149 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-196e156b-6802-4d5a-9d87-7199890de23f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Request method failure captured: Oct 03 15:02:45.986149 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: request: DELETE /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db HTTP/1.1 Oct 03 15:02:45.986149 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept: application/json Oct 03 15:02:45.986149 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept-Encoding: identity Oct 03 15:02:45.986149 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Connection: close Oct 03 15:02:45.986149 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Length: 0 Oct 03 15:02:45.986149 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Type: application/json Oct 03 15:02:45.986149 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Host: 10.222.0.46 Oct 03 15:02:45.986149 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Openstack-System-Scope: None Oct 03 15:02:45.986149 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: User-Agent: python-urllib3/1.26.12 Oct 03 15:02:45.986149 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Auth-Token: gAAAAABjOvcaThjSXmST5Zui92tHpMFw7Oxu-LFHnLknGWdFg73n571Y94smvW3XiTCJONsYXW31rAR_Uk3b29zBX0vJUsq5e-sWUiw8SznibgFubZYgKjvRE5b1DEDp_CtTDUUHWp1Zy_ofQJQKHoqdksglIT7DpAg5H98Wcz58Zuh9fuXxiw4 Oct 03 15:02:45.986149 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Id: None Oct 03 15:02:45.986149 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Name: None Oct 03 15:02:45.986149 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Identity-Status: Confirmed Oct 03 15:02:45.986149 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Is-Admin-Project: True Oct 03 15:02:45.986149 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Openstack-Nova-Api-Version: 2.20 Oct 03 15:02:45.986149 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Id: default Oct 03 15:02:45.986149 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Name: Default Oct 03 15:02:45.986149 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Id: 7f48b2441eec48c4ac784844e475a9e9 Oct 03 15:02:45.986149 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-558801479 Oct 03 15:02:45.986149 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Role: member,reader Oct 03 15:02:45.986149 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Roles: member,reader Oct 03 15:02:45.988135 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7f48b2441eec48c4ac784844e475a9e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7f48b2441eec48c4ac784844e475a9e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7f48b2441eec48c4ac784844e475a9e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7f48b2441eec48c4ac784844e475a9e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 15:02:45.988135 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant: tempest-AttachVolumeShelveTestJSON-558801479 Oct 03 15:02:45.988135 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Id: 7f48b2441eec48c4ac784844e475a9e9 Oct 03 15:02:45.988135 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-558801479 Oct 03 15:02:45.988135 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User: tempest-AttachVolumeShelveTestJSON-558801479-project Oct 03 15:02:45.988135 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Id: default Oct 03 15:02:45.988135 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Name: Default Oct 03 15:02:45.988135 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Id: 9e5325f010ae4359bd6b514a1995614d Oct 03 15:02:45.988135 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Name: tempest-AttachVolumeShelveTestJSON-558801479-project Oct 03 15:02:45.988135 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: method: > Oct 03 15:02:45.988135 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: exception: Instance 27879d6c-62f5-4281-b134-faecf706a2db could not be found. Oct 03 15:02:45.988135 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: action_args: {'id': '27879d6c-62f5-4281-b134-faecf706a2db'} Oct 03 15:02:45.989307 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:02:45.989307 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:45.989307 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:02:45.989307 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:02:45.989307 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:02:45.989307 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:02:45.989307 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:02:45.989307 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:02:45.989307 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:02:45.989307 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:02:45.989307 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27879d6c-62f5-4281-b134-faecf706a2db could not be found. Oct 03 15:02:45.989307 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:45.989307 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:45.989307 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:45.989307 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:45.989307 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:45.989307 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:45.989307 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:02:45.989307 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:02:45.989307 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:02:45.990829 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:02:45.990829 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 15:02:45.990829 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 15:02:45.990829 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 15:02:45.990829 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 15:02:45.990829 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:02:45.990829 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:02:45.990829 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:02:45.990829 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:02:45.990829 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27879d6c-62f5-4281-b134-faecf706a2db could not be found. Oct 03 15:02:45.990829 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:45.990829 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:45.990829 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:45.990829 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:45.990829 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:45.990829 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:45.990829 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:02:45.990829 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:02:45.990829 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27879d6c-62f5-4281-b134-faecf706a2db could not be found. Oct 03 15:02:45.990829 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:02:45.993312 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-196e156b-6802-4d5a-9d87-7199890de23f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Returning 404 to user: Instance 27879d6c-62f5-4281-b134-faecf706a2db could not be found. {{(pid=126851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:02:45.994188 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-196e156b-6802-4d5a-9d87-7199890de23f tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "DELETE /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 404 len: 111 microversion: 2.20 time: 0.045657 Oct 03 15:02:45.995223 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 542/1046] 10.222.0.46 () {60 vars in 1280 bytes} [Mon Oct 3 15:02:45 2022] DELETE /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 15:02:46.003001 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-8cdb93c8-9361-41a2-9ae5-1597d382dd22 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:46.003621 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-8cdb93c8-9361-41a2-9ae5-1597d382dd22 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] [instance: 27879d6c-62f5-4281-b134-faecf706a2db] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:46.009965 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8cdb93c8-9361-41a2-9ae5-1597d382dd22 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:46.010454 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8cdb93c8-9361-41a2-9ae5-1597d382dd22 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:46.011081 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8cdb93c8-9361-41a2-9ae5-1597d382dd22 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:46.011787 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8cdb93c8-9361-41a2-9ae5-1597d382dd22 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:46.012257 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8cdb93c8-9361-41a2-9ae5-1597d382dd22 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:46.012687 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8cdb93c8-9361-41a2-9ae5-1597d382dd22 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:46.026303 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.wsgi [None req-8cdb93c8-9361-41a2-9ae5-1597d382dd22 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] HTTP exception thrown: Instance 27879d6c-62f5-4281-b134-faecf706a2db could not be found. Oct 03 15:02:46.027878 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-8cdb93c8-9361-41a2-9ae5-1597d382dd22 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Request method failure captured: Oct 03 15:02:46.027878 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: request: GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db HTTP/1.1 Oct 03 15:02:46.027878 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept: application/json Oct 03 15:02:46.027878 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept-Encoding: identity Oct 03 15:02:46.027878 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Connection: close Oct 03 15:02:46.027878 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Length: 0 Oct 03 15:02:46.027878 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Type: application/json Oct 03 15:02:46.027878 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Host: 10.222.0.46 Oct 03 15:02:46.027878 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Openstack-System-Scope: None Oct 03 15:02:46.027878 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: User-Agent: python-urllib3/1.26.12 Oct 03 15:02:46.027878 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Auth-Token: gAAAAABjOvcaThjSXmST5Zui92tHpMFw7Oxu-LFHnLknGWdFg73n571Y94smvW3XiTCJONsYXW31rAR_Uk3b29zBX0vJUsq5e-sWUiw8SznibgFubZYgKjvRE5b1DEDp_CtTDUUHWp1Zy_ofQJQKHoqdksglIT7DpAg5H98Wcz58Zuh9fuXxiw4 Oct 03 15:02:46.027878 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Id: None Oct 03 15:02:46.027878 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Name: None Oct 03 15:02:46.027878 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Identity-Status: Confirmed Oct 03 15:02:46.027878 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Is-Admin-Project: True Oct 03 15:02:46.027878 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Openstack-Nova-Api-Version: 2.20 Oct 03 15:02:46.027878 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Id: default Oct 03 15:02:46.027878 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Name: Default Oct 03 15:02:46.027878 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Id: 7f48b2441eec48c4ac784844e475a9e9 Oct 03 15:02:46.027878 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-558801479 Oct 03 15:02:46.027878 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Role: member,reader Oct 03 15:02:46.027878 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Roles: member,reader Oct 03 15:02:46.029603 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7f48b2441eec48c4ac784844e475a9e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7f48b2441eec48c4ac784844e475a9e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7f48b2441eec48c4ac784844e475a9e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7f48b2441eec48c4ac784844e475a9e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 15:02:46.029603 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant: tempest-AttachVolumeShelveTestJSON-558801479 Oct 03 15:02:46.029603 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Id: 7f48b2441eec48c4ac784844e475a9e9 Oct 03 15:02:46.029603 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-558801479 Oct 03 15:02:46.029603 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User: tempest-AttachVolumeShelveTestJSON-558801479-project Oct 03 15:02:46.029603 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Id: default Oct 03 15:02:46.029603 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Name: Default Oct 03 15:02:46.029603 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Id: 9e5325f010ae4359bd6b514a1995614d Oct 03 15:02:46.029603 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Name: tempest-AttachVolumeShelveTestJSON-558801479-project Oct 03 15:02:46.029603 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: method: > Oct 03 15:02:46.029603 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: exception: Instance 27879d6c-62f5-4281-b134-faecf706a2db could not be found. Oct 03 15:02:46.029603 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: action_args: {'id': '27879d6c-62f5-4281-b134-faecf706a2db'} Oct 03 15:02:46.031075 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:02:46.031075 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:46.031075 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:02:46.031075 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:02:46.031075 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:02:46.031075 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:02:46.031075 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:02:46.031075 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:02:46.031075 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:02:46.031075 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:02:46.031075 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27879d6c-62f5-4281-b134-faecf706a2db could not be found. Oct 03 15:02:46.031075 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:46.031075 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:46.031075 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:46.031075 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:46.031075 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:46.031075 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:46.031075 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:02:46.031075 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:02:46.031075 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:02:46.032639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:02:46.032639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:02:46.032639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:02:46.032639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:02:46.032639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:02:46.032639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:02:46.032639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:02:46.032639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27879d6c-62f5-4281-b134-faecf706a2db could not be found. Oct 03 15:02:46.032639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:46.032639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:46.032639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:46.032639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:46.032639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:46.032639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:46.032639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:02:46.032639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:02:46.032639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27879d6c-62f5-4281-b134-faecf706a2db could not be found. Oct 03 15:02:46.032639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:02:46.034067 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-8cdb93c8-9361-41a2-9ae5-1597d382dd22 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] Returning 404 to user: Instance 27879d6c-62f5-4281-b134-faecf706a2db could not be found. {{(pid=126852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:02:46.034067 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-8cdb93c8-9361-41a2-9ae5-1597d382dd22 tempest-AttachVolumeShelveTestJSON-558801479 tempest-AttachVolumeShelveTestJSON-558801479-project] 10.222.0.46 "GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db" status: 404 len: 111 microversion: 2.20 time: 0.030218 Oct 03 15:02:46.034067 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 505/1047] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 3 15:02:45 2022] GET /compute/v2.1/servers/27879d6c-62f5-4281-b134-faecf706a2db => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 15:03:23.072088 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-c9a605ed-f72e-4351-857d-8a5cf5060f37 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:23.072604 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-c9a605ed-f72e-4351-857d-8a5cf5060f37 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 9de9bc00-4aed-4389-abb5-a31b43af2b7c] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:23.078269 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:03:23.078918 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:03:23.079760 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 15:03:23.079983 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Mon Oct 3 15:03:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c (ip 10.222.0.46) !!! Oct 03 15:03:23.082013 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c9a605ed-f72e-4351-857d-8a5cf5060f37 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:23.082569 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c9a605ed-f72e-4351-857d-8a5cf5060f37 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:23.083014 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c9a605ed-f72e-4351-857d-8a5cf5060f37 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:23.083759 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c9a605ed-f72e-4351-857d-8a5cf5060f37 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:23.084219 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c9a605ed-f72e-4351-857d-8a5cf5060f37 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:23.084650 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c9a605ed-f72e-4351-857d-8a5cf5060f37 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:23.086312 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:03:23.087200 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=28 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:03:23.125110 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-c9a605ed-f72e-4351-857d-8a5cf5060f37 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 9de9bc00-4aed-4389-abb5-a31b43af2b7c] Going to try to terminate instance {{(pid=126851) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:03:23.234848 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-c9a605ed-f72e-4351-857d-8a5cf5060f37 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c" status: 204 len: 0 microversion: 2.1 time: 0.165463 Oct 03 15:03:23.240120 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 543/1048] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 3 15:03:23 2022] DELETE /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:03:23.249151 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-5d05dd5c-a471-4622-b5a1-ff0729585ca1 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:23.250930 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-5d05dd5c-a471-4622-b5a1-ff0729585ca1 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 9de9bc00-4aed-4389-abb5-a31b43af2b7c] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:23.260068 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5d05dd5c-a471-4622-b5a1-ff0729585ca1 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:23.261849 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5d05dd5c-a471-4622-b5a1-ff0729585ca1 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:23.262305 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5d05dd5c-a471-4622-b5a1-ff0729585ca1 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:23.263027 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5d05dd5c-a471-4622-b5a1-ff0729585ca1 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:23.263497 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5d05dd5c-a471-4622-b5a1-ff0729585ca1 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:23.264103 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5d05dd5c-a471-4622-b5a1-ff0729585ca1 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:23.371284 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-9607fc1d-ac78-40d8-bb92-5494a86b39ce req-f15e7c3a-0e3e-417d-a4da-e9deee5cdca7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9de9bc00-4aed-4389-abb5-a31b43af2b7c", "tag": "27273ac0-a63f-4605-9d1e-5673f41cc216"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:03:23.383433 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-9607fc1d-ac78-40d8-bb92-5494a86b39ce req-f15e7c3a-0e3e-417d-a4da-e9deee5cdca7 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:23.384262 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-9607fc1d-ac78-40d8-bb92-5494a86b39ce req-f15e7c3a-0e3e-417d-a4da-e9deee5cdca7 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:23.384855 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-9607fc1d-ac78-40d8-bb92-5494a86b39ce req-f15e7c3a-0e3e-417d-a4da-e9deee5cdca7 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:23.403260 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-9607fc1d-ac78-40d8-bb92-5494a86b39ce req-f15e7c3a-0e3e-417d-a4da-e9deee5cdca7 service nova] Creating event network-changed:27273ac0-a63f-4605-9d1e-5673f41cc216 for instance 9de9bc00-4aed-4389-abb5-a31b43af2b7c on hv-cinder-85987 Oct 03 15:03:23.410158 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-9607fc1d-ac78-40d8-bb92-5494a86b39ce req-f15e7c3a-0e3e-417d-a4da-e9deee5cdca7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.331308 Oct 03 15:03:23.411881 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 506/1049] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 15:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:03:23.440914 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-5d05dd5c-a471-4622-b5a1-ff0729585ca1 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:23.449312 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-5d05dd5c-a471-4622-b5a1-ff0729585ca1 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c" status: 200 len: 1577 microversion: 2.1 time: 0.207173 Oct 03 15:03:23.449934 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 544/1050] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:23 2022] GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c => generated 1577 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:24.474720 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-3d0d6d02-f80d-4c13-834f-356620ddd47c tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:24.475456 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-3d0d6d02-f80d-4c13-834f-356620ddd47c tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 9de9bc00-4aed-4389-abb5-a31b43af2b7c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:24.481577 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3d0d6d02-f80d-4c13-834f-356620ddd47c tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:24.482063 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3d0d6d02-f80d-4c13-834f-356620ddd47c tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:24.482500 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3d0d6d02-f80d-4c13-834f-356620ddd47c tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:24.483178 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3d0d6d02-f80d-4c13-834f-356620ddd47c tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:24.483631 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3d0d6d02-f80d-4c13-834f-356620ddd47c tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:24.484052 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3d0d6d02-f80d-4c13-834f-356620ddd47c tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:24.639459 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-3d0d6d02-f80d-4c13-834f-356620ddd47c tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:24.649708 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-3d0d6d02-f80d-4c13-834f-356620ddd47c tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c" status: 200 len: 1577 microversion: 2.1 time: 0.179801 Oct 03 15:03:24.650941 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 507/1051] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:24 2022] GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c => generated 1577 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:25.687964 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-880c98a7-c700-4805-8f7c-14e5915dd3f8 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:25.688565 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-880c98a7-c700-4805-8f7c-14e5915dd3f8 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 9de9bc00-4aed-4389-abb5-a31b43af2b7c] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:25.695251 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-880c98a7-c700-4805-8f7c-14e5915dd3f8 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:25.695733 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-880c98a7-c700-4805-8f7c-14e5915dd3f8 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:25.696167 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-880c98a7-c700-4805-8f7c-14e5915dd3f8 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:25.696852 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-880c98a7-c700-4805-8f7c-14e5915dd3f8 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:25.697318 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-880c98a7-c700-4805-8f7c-14e5915dd3f8 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:25.697751 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-880c98a7-c700-4805-8f7c-14e5915dd3f8 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:25.829462 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-880c98a7-c700-4805-8f7c-14e5915dd3f8 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:25.837283 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-880c98a7-c700-4805-8f7c-14e5915dd3f8 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c" status: 200 len: 1459 microversion: 2.1 time: 0.153152 Oct 03 15:03:25.837870 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 545/1052] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:25 2022] GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c => generated 1459 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:26.440858 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-f3cee6c5-ecd6-43dd-a19b-3d0b0b2b3392 req-a3b5fa46-224a-4388-868c-842d9bd5ab32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9de9bc00-4aed-4389-abb5-a31b43af2b7c", "name": "network-vif-deleted", "tag": "27273ac0-a63f-4605-9d1e-5673f41cc216"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:03:26.452701 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-f3cee6c5-ecd6-43dd-a19b-3d0b0b2b3392 req-a3b5fa46-224a-4388-868c-842d9bd5ab32 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:26.453186 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-f3cee6c5-ecd6-43dd-a19b-3d0b0b2b3392 req-a3b5fa46-224a-4388-868c-842d9bd5ab32 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:26.453665 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-f3cee6c5-ecd6-43dd-a19b-3d0b0b2b3392 req-a3b5fa46-224a-4388-868c-842d9bd5ab32 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:26.465934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-f3cee6c5-ecd6-43dd-a19b-3d0b0b2b3392 req-a3b5fa46-224a-4388-868c-842d9bd5ab32 service nova] Creating event network-vif-deleted:27273ac0-a63f-4605-9d1e-5673f41cc216 for instance 9de9bc00-4aed-4389-abb5-a31b43af2b7c on hv-cinder-85987 Oct 03 15:03:26.472535 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-f3cee6c5-ecd6-43dd-a19b-3d0b0b2b3392 req-a3b5fa46-224a-4388-868c-842d9bd5ab32 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035776 Oct 03 15:03:26.473137 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 508/1053] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 15:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:03:26.860898 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-3ff8c710-45a9-479f-8d02-77911eb01f1c tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:26.861575 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-3ff8c710-45a9-479f-8d02-77911eb01f1c tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 9de9bc00-4aed-4389-abb5-a31b43af2b7c] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:26.867907 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3ff8c710-45a9-479f-8d02-77911eb01f1c tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:26.868392 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3ff8c710-45a9-479f-8d02-77911eb01f1c tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:26.868830 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3ff8c710-45a9-479f-8d02-77911eb01f1c tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:26.869529 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3ff8c710-45a9-479f-8d02-77911eb01f1c tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:26.869992 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3ff8c710-45a9-479f-8d02-77911eb01f1c tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:26.870415 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-3ff8c710-45a9-479f-8d02-77911eb01f1c tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:26.932677 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-3ff8c710-45a9-479f-8d02-77911eb01f1c tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:26.940381 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-3ff8c710-45a9-479f-8d02-77911eb01f1c tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c" status: 200 len: 1224 microversion: 2.1 time: 0.084068 Oct 03 15:03:26.940941 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 546/1054] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:26 2022] GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:27.964601 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-622f0eac-a95f-44ab-8231-263f96d9758a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:27.965886 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-622f0eac-a95f-44ab-8231-263f96d9758a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 9de9bc00-4aed-4389-abb5-a31b43af2b7c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:27.973086 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-622f0eac-a95f-44ab-8231-263f96d9758a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:27.973701 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-622f0eac-a95f-44ab-8231-263f96d9758a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:27.974035 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-622f0eac-a95f-44ab-8231-263f96d9758a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:27.974729 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-622f0eac-a95f-44ab-8231-263f96d9758a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:27.975186 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-622f0eac-a95f-44ab-8231-263f96d9758a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:27.975607 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-622f0eac-a95f-44ab-8231-263f96d9758a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:27.988939 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.wsgi [None req-622f0eac-a95f-44ab-8231-263f96d9758a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] HTTP exception thrown: Instance 9de9bc00-4aed-4389-abb5-a31b43af2b7c could not be found. Oct 03 15:03:27.990639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-622f0eac-a95f-44ab-8231-263f96d9758a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Request method failure captured: Oct 03 15:03:27.990639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: request: GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c HTTP/1.1 Oct 03 15:03:27.990639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept: application/json Oct 03 15:03:27.990639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept-Encoding: identity Oct 03 15:03:27.990639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Connection: close Oct 03 15:03:27.990639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Length: 0 Oct 03 15:03:27.990639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Type: application/json Oct 03 15:03:27.990639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Host: 10.222.0.46 Oct 03 15:03:27.990639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Openstack-System-Scope: None Oct 03 15:03:27.990639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: User-Agent: python-urllib3/1.26.12 Oct 03 15:03:27.990639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Auth-Token: gAAAAABjOvd_yfAMSPgbV_kqotbDRVM2bCx_MDpkfYn5lsgwSFYcN_6tnSV2gCAgCwxu-iL9vJf4cUuc27NUI4hTi_Fsn1J-iCVAmsske7UG4YSVz-RvyNq6-yuRtVIa7kMQ3Jg_tOd8Mlk1IaICYmSMTKqNUoc8UIHo2lph8JfYw-zqfQPT5jU Oct 03 15:03:27.990639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Id: None Oct 03 15:03:27.990639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Name: None Oct 03 15:03:27.990639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Identity-Status: Confirmed Oct 03 15:03:27.990639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Is-Admin-Project: True Oct 03 15:03:27.990639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Id: default Oct 03 15:03:27.990639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Name: Default Oct 03 15:03:27.990639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Id: a167b2ccacbc4e6d903b09d9a00650fe Oct 03 15:03:27.990639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Name: tempest-TestVolumeBootPattern-264473187 Oct 03 15:03:27.990639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Role: member,reader Oct 03 15:03:27.990639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Roles: member,reader Oct 03 15:03:27.992309 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a167b2ccacbc4e6d903b09d9a00650fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a167b2ccacbc4e6d903b09d9a00650fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a167b2ccacbc4e6d903b09d9a00650fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a167b2ccacbc4e6d903b09d9a00650fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 15:03:27.992309 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant: tempest-TestVolumeBootPattern-264473187 Oct 03 15:03:27.992309 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Id: a167b2ccacbc4e6d903b09d9a00650fe Oct 03 15:03:27.992309 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Name: tempest-TestVolumeBootPattern-264473187 Oct 03 15:03:27.992309 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User: tempest-TestVolumeBootPattern-264473187-project Oct 03 15:03:27.992309 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Id: default Oct 03 15:03:27.992309 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Name: Default Oct 03 15:03:27.992309 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Id: 7cfae014351641d8a949775875a45958 Oct 03 15:03:27.992309 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Name: tempest-TestVolumeBootPattern-264473187-project Oct 03 15:03:27.992309 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: method: > Oct 03 15:03:27.992309 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: exception: Instance 9de9bc00-4aed-4389-abb5-a31b43af2b7c could not be found. Oct 03 15:03:27.992309 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: action_args: {'id': '9de9bc00-4aed-4389-abb5-a31b43af2b7c'} Oct 03 15:03:27.993406 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:03:27.993406 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:03:27.993406 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:03:27.993406 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:03:27.993406 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:03:27.993406 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:03:27.993406 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:03:27.993406 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:03:27.993406 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:03:27.993406 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:03:27.993406 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9de9bc00-4aed-4389-abb5-a31b43af2b7c could not be found. Oct 03 15:03:27.993406 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:03:27.993406 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:03:27.993406 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:03:27.993406 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:03:27.993406 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:03:27.993406 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:03:27.993406 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:03:27.993406 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:03:27.993406 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:03:27.995011 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:03:27.995011 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:03:27.995011 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:03:27.995011 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:03:27.995011 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:03:27.995011 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:03:27.995011 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:03:27.995011 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9de9bc00-4aed-4389-abb5-a31b43af2b7c could not be found. Oct 03 15:03:27.995011 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:03:27.995011 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:03:27.995011 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:03:27.995011 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:03:27.995011 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:03:27.995011 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:03:27.995011 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:03:27.995011 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:03:27.995011 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9de9bc00-4aed-4389-abb5-a31b43af2b7c could not be found. Oct 03 15:03:27.995011 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:03:27.996555 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-622f0eac-a95f-44ab-8231-263f96d9758a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Returning 404 to user: Instance 9de9bc00-4aed-4389-abb5-a31b43af2b7c could not be found. {{(pid=126852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:03:27.996555 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-622f0eac-a95f-44ab-8231-263f96d9758a tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c" status: 404 len: 111 microversion: 2.1 time: 0.031694 Oct 03 15:03:27.996555 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 509/1055] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:27 2022] GET /compute/v2.1/servers/9de9bc00-4aed-4389-abb5-a31b43af2b7c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:03:31.041235 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-510ed7a6-8833-408a-8a82-3f54fc4b26be tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:31.041807 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-510ed7a6-8833-408a-8a82-3f54fc4b26be tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 1923d108-de98-422f-a3af-85b5bd792b35] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:31.044031 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-468c7402-d761-46a2-9051-2ed05083296c req-c4b729ad-2791-4d8c-978b-2a6348189f95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1923d108-de98-422f-a3af-85b5bd792b35", "tag": "96b0cff0-5314-4971-92cf-71b39981d342"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:03:31.048241 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-510ed7a6-8833-408a-8a82-3f54fc4b26be tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:31.048933 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-510ed7a6-8833-408a-8a82-3f54fc4b26be tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:31.049571 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-510ed7a6-8833-408a-8a82-3f54fc4b26be tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:31.050278 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-510ed7a6-8833-408a-8a82-3f54fc4b26be tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:31.050734 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-510ed7a6-8833-408a-8a82-3f54fc4b26be tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:31.051369 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-510ed7a6-8833-408a-8a82-3f54fc4b26be tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:31.054654 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-468c7402-d761-46a2-9051-2ed05083296c req-c4b729ad-2791-4d8c-978b-2a6348189f95 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:31.055215 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-468c7402-d761-46a2-9051-2ed05083296c req-c4b729ad-2791-4d8c-978b-2a6348189f95 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:31.055830 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-468c7402-d761-46a2-9051-2ed05083296c req-c4b729ad-2791-4d8c-978b-2a6348189f95 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:31.069979 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-468c7402-d761-46a2-9051-2ed05083296c req-c4b729ad-2791-4d8c-978b-2a6348189f95 service nova] Creating event network-changed:96b0cff0-5314-4971-92cf-71b39981d342 for instance 1923d108-de98-422f-a3af-85b5bd792b35 on hv-cinder-85987 Oct 03 15:03:31.074898 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-468c7402-d761-46a2-9051-2ed05083296c req-c4b729ad-2791-4d8c-978b-2a6348189f95 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034845 Oct 03 15:03:31.076137 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 510/1056] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 15:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:03:31.077348 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-510ed7a6-8833-408a-8a82-3f54fc4b26be tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 1923d108-de98-422f-a3af-85b5bd792b35] Going to try to terminate instance {{(pid=126851) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:03:31.159502 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-510ed7a6-8833-408a-8a82-3f54fc4b26be tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35" status: 204 len: 0 microversion: 2.1 time: 0.121920 Oct 03 15:03:31.162144 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 547/1057] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 3 15:03:31 2022] DELETE /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:03:31.173198 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-870ee1c0-ba71-41be-b2f5-e5e9380339da tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:31.173951 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-870ee1c0-ba71-41be-b2f5-e5e9380339da tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 1923d108-de98-422f-a3af-85b5bd792b35] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:31.181649 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-870ee1c0-ba71-41be-b2f5-e5e9380339da tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:31.182148 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-870ee1c0-ba71-41be-b2f5-e5e9380339da tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:31.182587 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-870ee1c0-ba71-41be-b2f5-e5e9380339da tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:31.183297 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-870ee1c0-ba71-41be-b2f5-e5e9380339da tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:31.183757 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-870ee1c0-ba71-41be-b2f5-e5e9380339da tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:31.184182 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-870ee1c0-ba71-41be-b2f5-e5e9380339da tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:31.324562 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-870ee1c0-ba71-41be-b2f5-e5e9380339da tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:31.333319 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-870ee1c0-ba71-41be-b2f5-e5e9380339da tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35" status: 200 len: 1577 microversion: 2.1 time: 0.165542 Oct 03 15:03:31.333917 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 511/1058] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:31 2022] GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:32.357110 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-c0690443-bd53-4410-8ed4-1b6c93ab7d63 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:32.357858 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-c0690443-bd53-4410-8ed4-1b6c93ab7d63 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 1923d108-de98-422f-a3af-85b5bd792b35] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:32.364178 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c0690443-bd53-4410-8ed4-1b6c93ab7d63 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:32.364656 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c0690443-bd53-4410-8ed4-1b6c93ab7d63 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:32.365087 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c0690443-bd53-4410-8ed4-1b6c93ab7d63 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:32.365797 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c0690443-bd53-4410-8ed4-1b6c93ab7d63 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:32.366274 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c0690443-bd53-4410-8ed4-1b6c93ab7d63 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:32.366689 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c0690443-bd53-4410-8ed4-1b6c93ab7d63 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:32.493046 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-c0690443-bd53-4410-8ed4-1b6c93ab7d63 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:32.500664 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-c0690443-bd53-4410-8ed4-1b6c93ab7d63 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35" status: 200 len: 1458 microversion: 2.1 time: 0.147805 Oct 03 15:03:32.501772 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 548/1059] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:32 2022] GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35 => generated 1458 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:33.276143 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-6857d074-d7f8-4f61-aad7-3bb4590dd69f req-4af6cefb-f7bc-4b35-a5fe-b669733512fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1923d108-de98-422f-a3af-85b5bd792b35", "name": "network-vif-deleted", "tag": "96b0cff0-5314-4971-92cf-71b39981d342"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:03:33.287038 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-6857d074-d7f8-4f61-aad7-3bb4590dd69f req-4af6cefb-f7bc-4b35-a5fe-b669733512fe service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:33.287546 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-6857d074-d7f8-4f61-aad7-3bb4590dd69f req-4af6cefb-f7bc-4b35-a5fe-b669733512fe service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:33.287975 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-6857d074-d7f8-4f61-aad7-3bb4590dd69f req-4af6cefb-f7bc-4b35-a5fe-b669733512fe service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:33.300888 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-6857d074-d7f8-4f61-aad7-3bb4590dd69f req-4af6cefb-f7bc-4b35-a5fe-b669733512fe service nova] Creating event network-vif-deleted:96b0cff0-5314-4971-92cf-71b39981d342 for instance 1923d108-de98-422f-a3af-85b5bd792b35 on hv-cinder-85987 Oct 03 15:03:33.305773 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-6857d074-d7f8-4f61-aad7-3bb4590dd69f req-4af6cefb-f7bc-4b35-a5fe-b669733512fe service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.221488 Oct 03 15:03:33.306352 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 512/1060] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 15:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:03:33.524383 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-1290fa49-5de8-4033-865b-77f7b57ada96 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:33.525000 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-1290fa49-5de8-4033-865b-77f7b57ada96 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 1923d108-de98-422f-a3af-85b5bd792b35] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:33.533064 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1290fa49-5de8-4033-865b-77f7b57ada96 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:33.533589 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1290fa49-5de8-4033-865b-77f7b57ada96 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:33.534159 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1290fa49-5de8-4033-865b-77f7b57ada96 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:33.535391 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1290fa49-5de8-4033-865b-77f7b57ada96 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:33.536169 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1290fa49-5de8-4033-865b-77f7b57ada96 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:33.536951 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1290fa49-5de8-4033-865b-77f7b57ada96 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:33.574442 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1290fa49-5de8-4033-865b-77f7b57ada96 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:33.574930 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1290fa49-5de8-4033-865b-77f7b57ada96 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:33.575372 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1290fa49-5de8-4033-865b-77f7b57ada96 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:33.575821 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.objects.instance [None req-1290fa49-5de8-4033-865b-77f7b57ada96 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lazy-loading 'fault' on Instance uuid 1923d108-de98-422f-a3af-85b5bd792b35 {{(pid=126851) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:03:33.616964 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-1290fa49-5de8-4033-865b-77f7b57ada96 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cfae014351641d8a949775875a45958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a167b2ccacbc4e6d903b09d9a00650fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:33.624623 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-1290fa49-5de8-4033-865b-77f7b57ada96 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35" status: 200 len: 1229 microversion: 2.1 time: 0.104346 Oct 03 15:03:33.625179 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 549/1061] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:33 2022] GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35 => generated 1229 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:34.649143 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-914c57e2-1d24-4acf-bccf-1ccb94b760e7 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:34.649896 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-914c57e2-1d24-4acf-bccf-1ccb94b760e7 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 1923d108-de98-422f-a3af-85b5bd792b35] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:34.656038 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-914c57e2-1d24-4acf-bccf-1ccb94b760e7 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:34.656513 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-914c57e2-1d24-4acf-bccf-1ccb94b760e7 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:34.656941 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-914c57e2-1d24-4acf-bccf-1ccb94b760e7 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:34.658244 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-914c57e2-1d24-4acf-bccf-1ccb94b760e7 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:34.658699 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-914c57e2-1d24-4acf-bccf-1ccb94b760e7 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:34.659119 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-914c57e2-1d24-4acf-bccf-1ccb94b760e7 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:34.672059 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.wsgi [None req-914c57e2-1d24-4acf-bccf-1ccb94b760e7 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] HTTP exception thrown: Instance 1923d108-de98-422f-a3af-85b5bd792b35 could not be found. Oct 03 15:03:34.673695 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-914c57e2-1d24-4acf-bccf-1ccb94b760e7 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Request method failure captured: Oct 03 15:03:34.673695 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: request: GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35 HTTP/1.1 Oct 03 15:03:34.673695 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept: application/json Oct 03 15:03:34.673695 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept-Encoding: identity Oct 03 15:03:34.673695 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Connection: close Oct 03 15:03:34.673695 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Length: 0 Oct 03 15:03:34.673695 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Type: application/json Oct 03 15:03:34.673695 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Host: 10.222.0.46 Oct 03 15:03:34.673695 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Openstack-System-Scope: None Oct 03 15:03:34.673695 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: User-Agent: python-urllib3/1.26.12 Oct 03 15:03:34.673695 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Auth-Token: gAAAAABjOvd_yfAMSPgbV_kqotbDRVM2bCx_MDpkfYn5lsgwSFYcN_6tnSV2gCAgCwxu-iL9vJf4cUuc27NUI4hTi_Fsn1J-iCVAmsske7UG4YSVz-RvyNq6-yuRtVIa7kMQ3Jg_tOd8Mlk1IaICYmSMTKqNUoc8UIHo2lph8JfYw-zqfQPT5jU Oct 03 15:03:34.673695 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Id: None Oct 03 15:03:34.673695 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Name: None Oct 03 15:03:34.673695 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Identity-Status: Confirmed Oct 03 15:03:34.673695 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Is-Admin-Project: True Oct 03 15:03:34.673695 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Id: default Oct 03 15:03:34.673695 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Name: Default Oct 03 15:03:34.673695 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Id: a167b2ccacbc4e6d903b09d9a00650fe Oct 03 15:03:34.673695 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Name: tempest-TestVolumeBootPattern-264473187 Oct 03 15:03:34.673695 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Role: member,reader Oct 03 15:03:34.673695 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Roles: member,reader Oct 03 15:03:34.675374 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a167b2ccacbc4e6d903b09d9a00650fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a167b2ccacbc4e6d903b09d9a00650fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a167b2ccacbc4e6d903b09d9a00650fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a167b2ccacbc4e6d903b09d9a00650fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 15:03:34.675374 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant: tempest-TestVolumeBootPattern-264473187 Oct 03 15:03:34.675374 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Id: a167b2ccacbc4e6d903b09d9a00650fe Oct 03 15:03:34.675374 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Name: tempest-TestVolumeBootPattern-264473187 Oct 03 15:03:34.675374 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User: tempest-TestVolumeBootPattern-264473187-project Oct 03 15:03:34.675374 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Id: default Oct 03 15:03:34.675374 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Name: Default Oct 03 15:03:34.675374 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Id: 7cfae014351641d8a949775875a45958 Oct 03 15:03:34.675374 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Name: tempest-TestVolumeBootPattern-264473187-project Oct 03 15:03:34.675374 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: method: > Oct 03 15:03:34.675374 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: exception: Instance 1923d108-de98-422f-a3af-85b5bd792b35 could not be found. Oct 03 15:03:34.675374 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: action_args: {'id': '1923d108-de98-422f-a3af-85b5bd792b35'} Oct 03 15:03:34.676330 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:03:34.676330 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:03:34.676330 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:03:34.676330 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:03:34.676330 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:03:34.676330 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:03:34.676330 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:03:34.676330 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:03:34.676330 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:03:34.676330 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:03:34.676330 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1923d108-de98-422f-a3af-85b5bd792b35 could not be found. Oct 03 15:03:34.676330 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:03:34.676330 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:03:34.676330 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:03:34.676330 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:03:34.676330 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:03:34.676330 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:03:34.676330 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:03:34.676330 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:03:34.676330 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:03:34.677934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:03:34.677934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:03:34.677934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:03:34.677934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:03:34.677934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:03:34.677934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:03:34.677934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:03:34.677934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1923d108-de98-422f-a3af-85b5bd792b35 could not be found. Oct 03 15:03:34.677934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:03:34.677934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:03:34.677934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:03:34.677934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:03:34.677934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:03:34.677934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:03:34.677934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:03:34.677934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:03:34.677934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1923d108-de98-422f-a3af-85b5bd792b35 could not be found. Oct 03 15:03:34.677934 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:03:34.679416 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-914c57e2-1d24-4acf-bccf-1ccb94b760e7 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Returning 404 to user: Instance 1923d108-de98-422f-a3af-85b5bd792b35 could not be found. {{(pid=126852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:03:34.679416 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-914c57e2-1d24-4acf-bccf-1ccb94b760e7 tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35" status: 404 len: 111 microversion: 2.1 time: 0.030612 Oct 03 15:03:34.679416 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 513/1062] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:34 2022] GET /compute/v2.1/servers/1923d108-de98-422f-a3af-85b5bd792b35 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:03:35.116018 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-42970e00-5394-4f8d-a6d4-d144177a58cc tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:35.116516 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-42970e00-5394-4f8d-a6d4-d144177a58cc tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:35.122921 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-42970e00-5394-4f8d-a6d4-d144177a58cc tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:35.123405 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-42970e00-5394-4f8d-a6d4-d144177a58cc tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:35.123846 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-42970e00-5394-4f8d-a6d4-d144177a58cc tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:35.124538 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-42970e00-5394-4f8d-a6d4-d144177a58cc tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:35.124998 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-42970e00-5394-4f8d-a6d4-d144177a58cc tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:35.125427 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-42970e00-5394-4f8d-a6d4-d144177a58cc tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:35.138863 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.wsgi [None req-42970e00-5394-4f8d-a6d4-d144177a58cc tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] HTTP exception thrown: Instance 8565107e-de79-4c29-a92d-0dcc47cdaad4 could not be found. Oct 03 15:03:35.140486 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-42970e00-5394-4f8d-a6d4-d144177a58cc tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Request method failure captured: Oct 03 15:03:35.140486 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: request: DELETE /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 HTTP/1.1 Oct 03 15:03:35.140486 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept: application/json Oct 03 15:03:35.140486 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept-Encoding: identity Oct 03 15:03:35.140486 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Connection: close Oct 03 15:03:35.140486 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Length: 0 Oct 03 15:03:35.140486 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Type: application/json Oct 03 15:03:35.140486 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Host: 10.222.0.46 Oct 03 15:03:35.140486 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Openstack-System-Scope: None Oct 03 15:03:35.140486 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: User-Agent: python-urllib3/1.26.12 Oct 03 15:03:35.140486 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Auth-Token: gAAAAABjOvd_yfAMSPgbV_kqotbDRVM2bCx_MDpkfYn5lsgwSFYcN_6tnSV2gCAgCwxu-iL9vJf4cUuc27NUI4hTi_Fsn1J-iCVAmsske7UG4YSVz-RvyNq6-yuRtVIa7kMQ3Jg_tOd8Mlk1IaICYmSMTKqNUoc8UIHo2lph8JfYw-zqfQPT5jU Oct 03 15:03:35.140486 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Id: None Oct 03 15:03:35.140486 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Name: None Oct 03 15:03:35.140486 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Identity-Status: Confirmed Oct 03 15:03:35.140486 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Is-Admin-Project: True Oct 03 15:03:35.140486 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Id: default Oct 03 15:03:35.140486 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Name: Default Oct 03 15:03:35.140486 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Id: a167b2ccacbc4e6d903b09d9a00650fe Oct 03 15:03:35.140486 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Name: tempest-TestVolumeBootPattern-264473187 Oct 03 15:03:35.140486 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Role: member,reader Oct 03 15:03:35.140486 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Roles: member,reader Oct 03 15:03:35.142211 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a167b2ccacbc4e6d903b09d9a00650fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a167b2ccacbc4e6d903b09d9a00650fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a167b2ccacbc4e6d903b09d9a00650fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a167b2ccacbc4e6d903b09d9a00650fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 15:03:35.142211 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant: tempest-TestVolumeBootPattern-264473187 Oct 03 15:03:35.142211 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Id: a167b2ccacbc4e6d903b09d9a00650fe Oct 03 15:03:35.142211 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Name: tempest-TestVolumeBootPattern-264473187 Oct 03 15:03:35.142211 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User: tempest-TestVolumeBootPattern-264473187-project Oct 03 15:03:35.142211 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Id: default Oct 03 15:03:35.142211 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Name: Default Oct 03 15:03:35.142211 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Id: 7cfae014351641d8a949775875a45958 Oct 03 15:03:35.142211 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Name: tempest-TestVolumeBootPattern-264473187-project Oct 03 15:03:35.142211 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: method: > Oct 03 15:03:35.142211 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: exception: Instance 8565107e-de79-4c29-a92d-0dcc47cdaad4 could not be found. Oct 03 15:03:35.142211 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: action_args: {'id': '8565107e-de79-4c29-a92d-0dcc47cdaad4'} Oct 03 15:03:35.143191 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:03:35.143191 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:03:35.143191 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:03:35.143191 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:03:35.143191 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:03:35.143191 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:03:35.143191 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:03:35.143191 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:03:35.143191 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:03:35.143191 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:03:35.143191 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8565107e-de79-4c29-a92d-0dcc47cdaad4 could not be found. Oct 03 15:03:35.143191 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:03:35.143191 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:03:35.143191 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:03:35.143191 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:03:35.143191 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:03:35.143191 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:03:35.143191 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:03:35.143191 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:03:35.143191 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:03:35.144660 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:03:35.144660 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 15:03:35.144660 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 15:03:35.144660 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 15:03:35.144660 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 15:03:35.144660 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:03:35.144660 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:03:35.144660 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:03:35.144660 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:03:35.144660 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8565107e-de79-4c29-a92d-0dcc47cdaad4 could not be found. Oct 03 15:03:35.144660 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:03:35.144660 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:03:35.144660 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:03:35.144660 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:03:35.144660 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:03:35.144660 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:03:35.144660 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:03:35.144660 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:03:35.144660 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8565107e-de79-4c29-a92d-0dcc47cdaad4 could not be found. Oct 03 15:03:35.144660 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:03:35.146330 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-42970e00-5394-4f8d-a6d4-d144177a58cc tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Returning 404 to user: Instance 8565107e-de79-4c29-a92d-0dcc47cdaad4 could not be found. {{(pid=126851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:03:35.146330 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-42970e00-5394-4f8d-a6d4-d144177a58cc tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 404 len: 111 microversion: 2.1 time: 0.029720 Oct 03 15:03:35.146330 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 550/1063] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 3 15:03:35 2022] DELETE /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:03:35.150420 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-21142f87-48c6-423d-96fe-f8ac917c63bc tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:35.151031 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-21142f87-48c6-423d-96fe-f8ac917c63bc tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] [instance: 8565107e-de79-4c29-a92d-0dcc47cdaad4] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:35.157872 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-21142f87-48c6-423d-96fe-f8ac917c63bc tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:35.158357 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-21142f87-48c6-423d-96fe-f8ac917c63bc tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:35.158795 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-21142f87-48c6-423d-96fe-f8ac917c63bc tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:35.159483 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-21142f87-48c6-423d-96fe-f8ac917c63bc tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:35.159952 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-21142f87-48c6-423d-96fe-f8ac917c63bc tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:35.160377 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-21142f87-48c6-423d-96fe-f8ac917c63bc tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:35.173904 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.wsgi [None req-21142f87-48c6-423d-96fe-f8ac917c63bc tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] HTTP exception thrown: Instance 8565107e-de79-4c29-a92d-0dcc47cdaad4 could not be found. Oct 03 15:03:35.175393 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-21142f87-48c6-423d-96fe-f8ac917c63bc tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Request method failure captured: Oct 03 15:03:35.175393 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: request: GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 HTTP/1.1 Oct 03 15:03:35.175393 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept: application/json Oct 03 15:03:35.175393 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept-Encoding: identity Oct 03 15:03:35.175393 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Connection: close Oct 03 15:03:35.175393 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Length: 0 Oct 03 15:03:35.175393 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Type: application/json Oct 03 15:03:35.175393 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Host: 10.222.0.46 Oct 03 15:03:35.175393 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Openstack-System-Scope: None Oct 03 15:03:35.175393 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: User-Agent: python-urllib3/1.26.12 Oct 03 15:03:35.175393 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Auth-Token: gAAAAABjOvd_yfAMSPgbV_kqotbDRVM2bCx_MDpkfYn5lsgwSFYcN_6tnSV2gCAgCwxu-iL9vJf4cUuc27NUI4hTi_Fsn1J-iCVAmsske7UG4YSVz-RvyNq6-yuRtVIa7kMQ3Jg_tOd8Mlk1IaICYmSMTKqNUoc8UIHo2lph8JfYw-zqfQPT5jU Oct 03 15:03:35.175393 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Id: None Oct 03 15:03:35.175393 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Name: None Oct 03 15:03:35.175393 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Identity-Status: Confirmed Oct 03 15:03:35.175393 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Is-Admin-Project: True Oct 03 15:03:35.175393 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Id: default Oct 03 15:03:35.175393 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Name: Default Oct 03 15:03:35.175393 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Id: a167b2ccacbc4e6d903b09d9a00650fe Oct 03 15:03:35.175393 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Name: tempest-TestVolumeBootPattern-264473187 Oct 03 15:03:35.175393 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Role: member,reader Oct 03 15:03:35.175393 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Roles: member,reader Oct 03 15:03:35.176989 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a167b2ccacbc4e6d903b09d9a00650fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a167b2ccacbc4e6d903b09d9a00650fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a167b2ccacbc4e6d903b09d9a00650fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a167b2ccacbc4e6d903b09d9a00650fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 15:03:35.176989 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant: tempest-TestVolumeBootPattern-264473187 Oct 03 15:03:35.176989 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Id: a167b2ccacbc4e6d903b09d9a00650fe Oct 03 15:03:35.176989 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Name: tempest-TestVolumeBootPattern-264473187 Oct 03 15:03:35.176989 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User: tempest-TestVolumeBootPattern-264473187-project Oct 03 15:03:35.176989 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Id: default Oct 03 15:03:35.176989 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Name: Default Oct 03 15:03:35.176989 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Id: 7cfae014351641d8a949775875a45958 Oct 03 15:03:35.176989 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Name: tempest-TestVolumeBootPattern-264473187-project Oct 03 15:03:35.176989 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: method: > Oct 03 15:03:35.176989 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: exception: Instance 8565107e-de79-4c29-a92d-0dcc47cdaad4 could not be found. Oct 03 15:03:35.176989 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: action_args: {'id': '8565107e-de79-4c29-a92d-0dcc47cdaad4'} Oct 03 15:03:35.177920 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:03:35.177920 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:03:35.177920 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:03:35.177920 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:03:35.177920 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:03:35.177920 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:03:35.177920 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:03:35.177920 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:03:35.177920 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:03:35.177920 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:03:35.177920 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8565107e-de79-4c29-a92d-0dcc47cdaad4 could not be found. Oct 03 15:03:35.177920 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:03:35.177920 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:03:35.177920 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:03:35.177920 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:03:35.177920 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:03:35.177920 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:03:35.177920 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:03:35.177920 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:03:35.177920 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:03:35.179363 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:03:35.179363 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:03:35.179363 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:03:35.179363 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:03:35.179363 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:03:35.179363 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:03:35.179363 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:03:35.179363 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8565107e-de79-4c29-a92d-0dcc47cdaad4 could not be found. Oct 03 15:03:35.179363 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:03:35.179363 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:03:35.179363 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:03:35.179363 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:03:35.179363 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:03:35.179363 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:03:35.179363 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:03:35.179363 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:03:35.179363 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8565107e-de79-4c29-a92d-0dcc47cdaad4 could not be found. Oct 03 15:03:35.179363 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:03:35.180735 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-21142f87-48c6-423d-96fe-f8ac917c63bc tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Returning 404 to user: Instance 8565107e-de79-4c29-a92d-0dcc47cdaad4 could not be found. {{(pid=126852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:03:35.180735 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-21142f87-48c6-423d-96fe-f8ac917c63bc tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4" status: 404 len: 111 microversion: 2.1 time: 0.030193 Oct 03 15:03:35.180735 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 514/1064] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:35 2022] GET /compute/v2.1/servers/8565107e-de79-4c29-a92d-0dcc47cdaad4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:03:36.477775 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-1abd16da-0ca8-4b0a-b290-b08a7ec26b7f tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] Calling method '.version_select at 0x7fe0d6c849d0>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:36.509182 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-1abd16da-0ca8-4b0a-b290-b08a7ec26b7f tempest-TestVolumeBootPattern-264473187 tempest-TestVolumeBootPattern-264473187-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-296655480" status: 202 len: 0 microversion: 2.1 time: 0.035003 Oct 03 15:03:36.513462 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 551/1065] 10.222.0.46 () {58 vars in 1260 bytes} [Mon Oct 3 15:03:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-296655480 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 15:03:58.776629 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-1e58288f-10ef-441e-96f6-b2b42c28bee3 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-863102931", "imageRef": "add7a872-2ca1-4366-9a93-f0663fdb297b", "flavorRef": "452", "networks": [{"uuid": "6dfe7b06-6ddf-4afa-a9b3-ca0f8f68c45a"}]}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:03:58.786659 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_api:SELECT=18 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:03:58.787311 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=26 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:03:58.833220 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.network.neutron [None req-1e58288f-10ef-441e-96f6-b2b42c28bee3 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] validate_networks() for [('6dfe7b06-6ddf-4afa-a9b3-ca0f8f68c45a', None, None, None, None, None)] {{(pid=126852) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:03:59.263467 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-1e58288f-10ef-441e-96f6-b2b42c28bee3 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Flavor limits 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:03:59.263956 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-1e58288f-10ef-441e-96f6-b2b42c28bee3 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Image limits 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:03:59.264573 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-1e58288f-10ef-441e-96f6-b2b42c28bee3 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Flavor pref 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:03:59.265072 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-1e58288f-10ef-441e-96f6-b2b42c28bee3 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Image pref 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:03:59.265483 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-1e58288f-10ef-441e-96f6-b2b42c28bee3 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:03:59.275050 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1e58288f-10ef-441e-96f6-b2b42c28bee3 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:59.275562 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1e58288f-10ef-441e-96f6-b2b42c28bee3 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:59.281021 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1e58288f-10ef-441e-96f6-b2b42c28bee3 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:59.281839 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1e58288f-10ef-441e-96f6-b2b42c28bee3 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:59.282522 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1e58288f-10ef-441e-96f6-b2b42c28bee3 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:59.283233 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1e58288f-10ef-441e-96f6-b2b42c28bee3 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:59.301303 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-1e58288f-10ef-441e-96f6-b2b42c28bee3 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Getting quotas for project 41772d612abc4efa9a7c50a78da63dce. Resources: {'ram', 'instances', 'cores'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:03:59.305786 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-1e58288f-10ef-441e-96f6-b2b42c28bee3 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Getting quotas for user 44b3d40ccf454abeb3abda102fe97925 and project 41772d612abc4efa9a7c50a78da63dce. Resources: {'ram', 'instances', 'cores'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:03:59.318042 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-1e58288f-10ef-441e-96f6-b2b42c28bee3 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Going to run 1 instances... {{(pid=126852) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:03:59.321669 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-1e58288f-10ef-441e-96f6-b2b42c28bee3 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [instance: e5c44b38-0545-41bd-a050-7f8607d179ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='add7a872-2ca1-4366-9a93-f0663fdb297b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:03:59.363868 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1e58288f-10ef-441e-96f6-b2b42c28bee3 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [21ca65e6-5af5-4824-af44-dcd4835fd6f9] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 15:04:00.371585 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO oslo.messaging._drivers.impl_rabbit [None req-1e58288f-10ef-441e-96f6-b2b42c28bee3 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [21ca65e6-5af5-4824-af44-dcd4835fd6f9] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 44230. Oct 03 15:04:00.375866 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-1e58288f-10ef-441e-96f6-b2b42c28bee3 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.603293 Oct 03 15:04:00.376628 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 515/1066] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 3 15:03:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:04:00.387680 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-28034e91-b804-4dbe-b258-675b9d65fdce tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:00.388294 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-28034e91-b804-4dbe-b258-675b9d65fdce tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [instance: e5c44b38-0545-41bd-a050-7f8607d179ce] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:00.390654 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:04:00.391301 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:04:00.392899 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 15:04:00.393066 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Mon Oct 3 15:04:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e5c44b38-0545-41bd-a050-7f8607d179ce (ip 10.222.0.46) !!! Oct 03 15:04:00.468085 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-28034e91-b804-4dbe-b258-675b9d65fdce tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b3d40ccf454abeb3abda102fe97925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41772d612abc4efa9a7c50a78da63dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:00.475691 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-28034e91-b804-4dbe-b258-675b9d65fdce tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] 10.222.0.46 "GET /compute/v2.1/servers/e5c44b38-0545-41bd-a050-7f8607d179ce" status: 200 len: 1213 microversion: 2.1 time: 0.091844 Oct 03 15:04:00.476258 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 552/1067] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:00 2022] GET /compute/v2.1/servers/e5c44b38-0545-41bd-a050-7f8607d179ce => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:01.499097 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-77ad31f9-6bef-468c-8151-22da8726477f tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:01.499708 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-77ad31f9-6bef-468c-8151-22da8726477f tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [instance: e5c44b38-0545-41bd-a050-7f8607d179ce] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:01.506426 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-77ad31f9-6bef-468c-8151-22da8726477f tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:01.507068 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-77ad31f9-6bef-468c-8151-22da8726477f tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:01.507528 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-77ad31f9-6bef-468c-8151-22da8726477f tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:01.508226 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-77ad31f9-6bef-468c-8151-22da8726477f tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:01.508782 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-77ad31f9-6bef-468c-8151-22da8726477f tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:01.509236 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-77ad31f9-6bef-468c-8151-22da8726477f tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:01.576363 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-77ad31f9-6bef-468c-8151-22da8726477f tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b3d40ccf454abeb3abda102fe97925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41772d612abc4efa9a7c50a78da63dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:01.585425 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-77ad31f9-6bef-468c-8151-22da8726477f tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] 10.222.0.46 "GET /compute/v2.1/servers/e5c44b38-0545-41bd-a050-7f8607d179ce" status: 200 len: 1265 microversion: 2.1 time: 0.091063 Oct 03 15:04:01.586277 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 516/1068] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:01 2022] GET /compute/v2.1/servers/e5c44b38-0545-41bd-a050-7f8607d179ce => generated 1265 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:02.610911 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-ddbef9a0-0710-4707-918f-25c8628b9780 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:02.612049 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-ddbef9a0-0710-4707-918f-25c8628b9780 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [instance: e5c44b38-0545-41bd-a050-7f8607d179ce] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:02.618871 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ddbef9a0-0710-4707-918f-25c8628b9780 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:02.619563 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ddbef9a0-0710-4707-918f-25c8628b9780 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:02.620169 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ddbef9a0-0710-4707-918f-25c8628b9780 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:02.621043 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ddbef9a0-0710-4707-918f-25c8628b9780 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:02.621719 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ddbef9a0-0710-4707-918f-25c8628b9780 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:02.622308 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ddbef9a0-0710-4707-918f-25c8628b9780 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:02.855721 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-ddbef9a0-0710-4707-918f-25c8628b9780 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b3d40ccf454abeb3abda102fe97925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41772d612abc4efa9a7c50a78da63dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:02.865787 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-ddbef9a0-0710-4707-918f-25c8628b9780 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] 10.222.0.46 "GET /compute/v2.1/servers/e5c44b38-0545-41bd-a050-7f8607d179ce" status: 200 len: 1313 microversion: 2.1 time: 0.258642 Oct 03 15:04:02.866358 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 553/1069] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:02 2022] GET /compute/v2.1/servers/e5c44b38-0545-41bd-a050-7f8607d179ce => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:03.087685 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-10f2268f-626a-4ecc-9c08-00e39d119bc9 req-89a9b84e-de40-4ef9-b9c4-a883c3a16a4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5c44b38-0545-41bd-a050-7f8607d179ce", "tag": "422f7fcd-8f8e-4cda-af5a-de109cd906c2"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:04:03.099630 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-10f2268f-626a-4ecc-9c08-00e39d119bc9 req-89a9b84e-de40-4ef9-b9c4-a883c3a16a4a service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:03.100110 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-10f2268f-626a-4ecc-9c08-00e39d119bc9 req-89a9b84e-de40-4ef9-b9c4-a883c3a16a4a service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:03.100544 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-10f2268f-626a-4ecc-9c08-00e39d119bc9 req-89a9b84e-de40-4ef9-b9c4-a883c3a16a4a service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:03.115379 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-10f2268f-626a-4ecc-9c08-00e39d119bc9 req-89a9b84e-de40-4ef9-b9c4-a883c3a16a4a service nova] Creating event network-changed:422f7fcd-8f8e-4cda-af5a-de109cd906c2 for instance e5c44b38-0545-41bd-a050-7f8607d179ce on hv-cinder-85987 Oct 03 15:04:03.120301 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-10f2268f-626a-4ecc-9c08-00e39d119bc9 req-89a9b84e-de40-4ef9-b9c4-a883c3a16a4a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038218 Oct 03 15:04:03.121092 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 517/1070] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 15:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:04:03.888568 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-e12bfb59-c5cd-4e53-9d47-fe23f02e8692 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:03.889272 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-e12bfb59-c5cd-4e53-9d47-fe23f02e8692 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [instance: e5c44b38-0545-41bd-a050-7f8607d179ce] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:03.895758 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e12bfb59-c5cd-4e53-9d47-fe23f02e8692 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:03.896325 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e12bfb59-c5cd-4e53-9d47-fe23f02e8692 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:03.896836 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e12bfb59-c5cd-4e53-9d47-fe23f02e8692 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:03.897669 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e12bfb59-c5cd-4e53-9d47-fe23f02e8692 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:03.898370 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e12bfb59-c5cd-4e53-9d47-fe23f02e8692 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:03.898663 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-e12bfb59-c5cd-4e53-9d47-fe23f02e8692 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:04.039398 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-e12bfb59-c5cd-4e53-9d47-fe23f02e8692 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b3d40ccf454abeb3abda102fe97925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41772d612abc4efa9a7c50a78da63dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:04.047062 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-e12bfb59-c5cd-4e53-9d47-fe23f02e8692 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] 10.222.0.46 "GET /compute/v2.1/servers/e5c44b38-0545-41bd-a050-7f8607d179ce" status: 200 len: 1313 microversion: 2.1 time: 0.162371 Oct 03 15:04:04.047522 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 554/1071] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:03 2022] GET /compute/v2.1/servers/e5c44b38-0545-41bd-a050-7f8607d179ce => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:05.070395 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-1c0258e7-2ddc-42b2-a7dd-d0ceea9811f0 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:05.071084 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-1c0258e7-2ddc-42b2-a7dd-d0ceea9811f0 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [instance: e5c44b38-0545-41bd-a050-7f8607d179ce] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:05.077676 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1c0258e7-2ddc-42b2-a7dd-d0ceea9811f0 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:05.078159 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1c0258e7-2ddc-42b2-a7dd-d0ceea9811f0 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:05.078594 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1c0258e7-2ddc-42b2-a7dd-d0ceea9811f0 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:05.079289 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1c0258e7-2ddc-42b2-a7dd-d0ceea9811f0 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:05.079745 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1c0258e7-2ddc-42b2-a7dd-d0ceea9811f0 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:05.080188 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1c0258e7-2ddc-42b2-a7dd-d0ceea9811f0 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:05.210363 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-1c0258e7-2ddc-42b2-a7dd-d0ceea9811f0 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b3d40ccf454abeb3abda102fe97925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41772d612abc4efa9a7c50a78da63dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:05.217942 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-1c0258e7-2ddc-42b2-a7dd-d0ceea9811f0 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] 10.222.0.46 "GET /compute/v2.1/servers/e5c44b38-0545-41bd-a050-7f8607d179ce" status: 200 len: 1313 microversion: 2.1 time: 0.151702 Oct 03 15:04:05.218507 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 518/1072] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:05 2022] GET /compute/v2.1/servers/e5c44b38-0545-41bd-a050-7f8607d179ce => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:06.240665 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-73c645e5-49fd-4d4d-ba15-d3c49cbce6da tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:06.241306 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-73c645e5-49fd-4d4d-ba15-d3c49cbce6da tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [instance: e5c44b38-0545-41bd-a050-7f8607d179ce] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:06.247768 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-73c645e5-49fd-4d4d-ba15-d3c49cbce6da tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:06.248253 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-73c645e5-49fd-4d4d-ba15-d3c49cbce6da tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:06.248693 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-73c645e5-49fd-4d4d-ba15-d3c49cbce6da tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:06.249382 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-73c645e5-49fd-4d4d-ba15-d3c49cbce6da tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:06.249868 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-73c645e5-49fd-4d4d-ba15-d3c49cbce6da tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:06.250295 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-73c645e5-49fd-4d4d-ba15-d3c49cbce6da tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:06.375119 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-73c645e5-49fd-4d4d-ba15-d3c49cbce6da tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b3d40ccf454abeb3abda102fe97925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41772d612abc4efa9a7c50a78da63dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:06.382733 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-73c645e5-49fd-4d4d-ba15-d3c49cbce6da tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] 10.222.0.46 "GET /compute/v2.1/servers/e5c44b38-0545-41bd-a050-7f8607d179ce" status: 200 len: 1313 microversion: 2.1 time: 0.146508 Oct 03 15:04:06.383297 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 555/1073] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:06 2022] GET /compute/v2.1/servers/e5c44b38-0545-41bd-a050-7f8607d179ce => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:07.405776 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-71d633dc-e9f7-449f-8a77-e183a6234e41 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:07.406381 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-71d633dc-e9f7-449f-8a77-e183a6234e41 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [instance: e5c44b38-0545-41bd-a050-7f8607d179ce] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:07.413286 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-71d633dc-e9f7-449f-8a77-e183a6234e41 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:07.413791 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-71d633dc-e9f7-449f-8a77-e183a6234e41 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:07.414221 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-71d633dc-e9f7-449f-8a77-e183a6234e41 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:07.414903 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-71d633dc-e9f7-449f-8a77-e183a6234e41 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:07.415350 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-71d633dc-e9f7-449f-8a77-e183a6234e41 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:07.415768 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-71d633dc-e9f7-449f-8a77-e183a6234e41 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:07.545388 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-71d633dc-e9f7-449f-8a77-e183a6234e41 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b3d40ccf454abeb3abda102fe97925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41772d612abc4efa9a7c50a78da63dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:07.553666 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-71d633dc-e9f7-449f-8a77-e183a6234e41 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] 10.222.0.46 "GET /compute/v2.1/servers/e5c44b38-0545-41bd-a050-7f8607d179ce" status: 200 len: 1313 microversion: 2.1 time: 0.151705 Oct 03 15:04:07.554223 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 519/1074] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:07 2022] GET /compute/v2.1/servers/e5c44b38-0545-41bd-a050-7f8607d179ce => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:08.576122 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-dc60ebba-de9c-4a9d-8a28-a35923818984 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:08.576755 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-dc60ebba-de9c-4a9d-8a28-a35923818984 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [instance: e5c44b38-0545-41bd-a050-7f8607d179ce] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:08.583894 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dc60ebba-de9c-4a9d-8a28-a35923818984 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:08.584355 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dc60ebba-de9c-4a9d-8a28-a35923818984 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:08.584785 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dc60ebba-de9c-4a9d-8a28-a35923818984 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:08.585458 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dc60ebba-de9c-4a9d-8a28-a35923818984 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:08.585933 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dc60ebba-de9c-4a9d-8a28-a35923818984 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:08.586350 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-dc60ebba-de9c-4a9d-8a28-a35923818984 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:08.714452 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-dc60ebba-de9c-4a9d-8a28-a35923818984 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b3d40ccf454abeb3abda102fe97925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41772d612abc4efa9a7c50a78da63dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:08.722766 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-dc60ebba-de9c-4a9d-8a28-a35923818984 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] 10.222.0.46 "GET /compute/v2.1/servers/e5c44b38-0545-41bd-a050-7f8607d179ce" status: 200 len: 1313 microversion: 2.1 time: 0.150483 Oct 03 15:04:08.723323 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 556/1075] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:08 2022] GET /compute/v2.1/servers/e5c44b38-0545-41bd-a050-7f8607d179ce => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:09.744548 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-9a08d6e5-1485-408e-ad00-9c4d5685c94d tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:09.745195 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-9a08d6e5-1485-408e-ad00-9c4d5685c94d tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [instance: e5c44b38-0545-41bd-a050-7f8607d179ce] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:09.747642 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell0:SELECT=2 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:04:09.748337 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell0:SELECT=6 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:04:09.754220 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9a08d6e5-1485-408e-ad00-9c4d5685c94d tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:09.754702 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9a08d6e5-1485-408e-ad00-9c4d5685c94d tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:09.755140 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9a08d6e5-1485-408e-ad00-9c4d5685c94d tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:09.755830 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9a08d6e5-1485-408e-ad00-9c4d5685c94d tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:09.756286 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9a08d6e5-1485-408e-ad00-9c4d5685c94d tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:09.756709 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9a08d6e5-1485-408e-ad00-9c4d5685c94d tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:09.882058 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-9a08d6e5-1485-408e-ad00-9c4d5685c94d tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b3d40ccf454abeb3abda102fe97925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41772d612abc4efa9a7c50a78da63dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:09.889559 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-9a08d6e5-1485-408e-ad00-9c4d5685c94d tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] 10.222.0.46 "GET /compute/v2.1/servers/e5c44b38-0545-41bd-a050-7f8607d179ce" status: 200 len: 1313 microversion: 2.1 time: 0.148837 Oct 03 15:04:09.890116 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 520/1076] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:09 2022] GET /compute/v2.1/servers/e5c44b38-0545-41bd-a050-7f8607d179ce => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:10.911873 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-1355bc9a-2ee1-49f4-8d0c-0a0ba401eaea tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:10.912482 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-1355bc9a-2ee1-49f4-8d0c-0a0ba401eaea tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [instance: e5c44b38-0545-41bd-a050-7f8607d179ce] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:10.914548 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell0:SELECT=2 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:04:10.919863 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1355bc9a-2ee1-49f4-8d0c-0a0ba401eaea tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:10.920345 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1355bc9a-2ee1-49f4-8d0c-0a0ba401eaea tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:10.920783 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1355bc9a-2ee1-49f4-8d0c-0a0ba401eaea tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:10.921477 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1355bc9a-2ee1-49f4-8d0c-0a0ba401eaea tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:10.921954 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1355bc9a-2ee1-49f4-8d0c-0a0ba401eaea tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:10.922379 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1355bc9a-2ee1-49f4-8d0c-0a0ba401eaea tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:11.058227 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-1355bc9a-2ee1-49f4-8d0c-0a0ba401eaea tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b3d40ccf454abeb3abda102fe97925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41772d612abc4efa9a7c50a78da63dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:11.066417 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-1355bc9a-2ee1-49f4-8d0c-0a0ba401eaea tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] 10.222.0.46 "GET /compute/v2.1/servers/e5c44b38-0545-41bd-a050-7f8607d179ce" status: 200 len: 1313 microversion: 2.1 time: 0.157900 Oct 03 15:04:11.067278 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 557/1077] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:10 2022] GET /compute/v2.1/servers/e5c44b38-0545-41bd-a050-7f8607d179ce => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:12.090012 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-ff1439ea-c020-4a22-b3f2-8b2e140a1417 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:12.090631 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-ff1439ea-c020-4a22-b3f2-8b2e140a1417 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [instance: e5c44b38-0545-41bd-a050-7f8607d179ce] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:12.097015 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ff1439ea-c020-4a22-b3f2-8b2e140a1417 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:12.097624 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ff1439ea-c020-4a22-b3f2-8b2e140a1417 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:12.098097 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ff1439ea-c020-4a22-b3f2-8b2e140a1417 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:12.098829 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ff1439ea-c020-4a22-b3f2-8b2e140a1417 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:12.099288 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ff1439ea-c020-4a22-b3f2-8b2e140a1417 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:12.099718 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ff1439ea-c020-4a22-b3f2-8b2e140a1417 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:12.239209 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-ff1439ea-c020-4a22-b3f2-8b2e140a1417 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b3d40ccf454abeb3abda102fe97925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41772d612abc4efa9a7c50a78da63dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:12.246962 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-ff1439ea-c020-4a22-b3f2-8b2e140a1417 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] 10.222.0.46 "GET /compute/v2.1/servers/e5c44b38-0545-41bd-a050-7f8607d179ce" status: 200 len: 1313 microversion: 2.1 time: 0.160926 Oct 03 15:04:12.247534 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 521/1078] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:12 2022] GET /compute/v2.1/servers/e5c44b38-0545-41bd-a050-7f8607d179ce => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:12.404899 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-ced3e593-3872-4239-90f9-5aa562232a48 req-0c90a5b2-d30f-485a-8c7e-a117c2c00b16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5c44b38-0545-41bd-a050-7f8607d179ce", "name": "network-vif-plugged", "status": "completed", "tag": "422f7fcd-8f8e-4cda-af5a-de109cd906c2"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:04:12.414112 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-ced3e593-3872-4239-90f9-5aa562232a48 req-0c90a5b2-d30f-485a-8c7e-a117c2c00b16 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:12.414578 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-ced3e593-3872-4239-90f9-5aa562232a48 req-0c90a5b2-d30f-485a-8c7e-a117c2c00b16 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:12.415005 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-ced3e593-3872-4239-90f9-5aa562232a48 req-0c90a5b2-d30f-485a-8c7e-a117c2c00b16 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:12.426200 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-ced3e593-3872-4239-90f9-5aa562232a48 req-0c90a5b2-d30f-485a-8c7e-a117c2c00b16 service nova] Creating event network-vif-plugged:422f7fcd-8f8e-4cda-af5a-de109cd906c2 for instance e5c44b38-0545-41bd-a050-7f8607d179ce on hv-cinder-85987 Oct 03 15:04:12.431073 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-ced3e593-3872-4239-90f9-5aa562232a48 req-0c90a5b2-d30f-485a-8c7e-a117c2c00b16 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152606 Oct 03 15:04:12.431628 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 558/1079] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 15:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:04:13.272071 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-eb19dd99-f6f6-4a72-90e1-328f9b29ffcf tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:13.272961 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-eb19dd99-f6f6-4a72-90e1-328f9b29ffcf tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [instance: e5c44b38-0545-41bd-a050-7f8607d179ce] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:13.285736 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-eb19dd99-f6f6-4a72-90e1-328f9b29ffcf tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:13.286222 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-eb19dd99-f6f6-4a72-90e1-328f9b29ffcf tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:13.286702 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-eb19dd99-f6f6-4a72-90e1-328f9b29ffcf tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:13.287334 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-eb19dd99-f6f6-4a72-90e1-328f9b29ffcf tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:13.287854 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-eb19dd99-f6f6-4a72-90e1-328f9b29ffcf tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:13.288191 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-eb19dd99-f6f6-4a72-90e1-328f9b29ffcf tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:13.436278 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-eb19dd99-f6f6-4a72-90e1-328f9b29ffcf tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b3d40ccf454abeb3abda102fe97925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41772d612abc4efa9a7c50a78da63dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:13.444702 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-eb19dd99-f6f6-4a72-90e1-328f9b29ffcf tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] 10.222.0.46 "GET /compute/v2.1/servers/e5c44b38-0545-41bd-a050-7f8607d179ce" status: 200 len: 1313 microversion: 2.1 time: 0.177603 Oct 03 15:04:13.445359 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 522/1080] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:13 2022] GET /compute/v2.1/servers/e5c44b38-0545-41bd-a050-7f8607d179ce => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:14.469680 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-64942aaa-5ef3-41dd-9866-59a16acb8114 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:14.470398 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-64942aaa-5ef3-41dd-9866-59a16acb8114 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [instance: e5c44b38-0545-41bd-a050-7f8607d179ce] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:14.477232 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-64942aaa-5ef3-41dd-9866-59a16acb8114 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:14.477742 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-64942aaa-5ef3-41dd-9866-59a16acb8114 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:14.478169 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-64942aaa-5ef3-41dd-9866-59a16acb8114 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:14.478848 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-64942aaa-5ef3-41dd-9866-59a16acb8114 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:14.479298 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-64942aaa-5ef3-41dd-9866-59a16acb8114 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:14.479714 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-64942aaa-5ef3-41dd-9866-59a16acb8114 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:14.605473 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-64942aaa-5ef3-41dd-9866-59a16acb8114 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b3d40ccf454abeb3abda102fe97925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41772d612abc4efa9a7c50a78da63dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:14.613877 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-64942aaa-5ef3-41dd-9866-59a16acb8114 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] 10.222.0.46 "GET /compute/v2.1/servers/e5c44b38-0545-41bd-a050-7f8607d179ce" status: 200 len: 1498 microversion: 2.1 time: 0.149104 Oct 03 15:04:14.614430 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 559/1081] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:14 2022] GET /compute/v2.1/servers/e5c44b38-0545-41bd-a050-7f8607d179ce => generated 1498 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:15.109013 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-56128a54-b783-4620-a1a3-5a4360c4f1ea tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:15.109575 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-56128a54-b783-4620-a1a3-5a4360c4f1ea tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [instance: e5c44b38-0545-41bd-a050-7f8607d179ce] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:15.116507 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-56128a54-b783-4620-a1a3-5a4360c4f1ea tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:15.116994 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-56128a54-b783-4620-a1a3-5a4360c4f1ea tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:15.117432 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-56128a54-b783-4620-a1a3-5a4360c4f1ea tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:15.118152 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-56128a54-b783-4620-a1a3-5a4360c4f1ea tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:15.118610 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-56128a54-b783-4620-a1a3-5a4360c4f1ea tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:15.119037 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-56128a54-b783-4620-a1a3-5a4360c4f1ea tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:15.143349 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-56128a54-b783-4620-a1a3-5a4360c4f1ea tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [instance: e5c44b38-0545-41bd-a050-7f8607d179ce] Going to try to terminate instance {{(pid=126852) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:04:15.217107 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-56128a54-b783-4620-a1a3-5a4360c4f1ea tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e5c44b38-0545-41bd-a050-7f8607d179ce" status: 204 len: 0 microversion: 2.1 time: 0.111575 Oct 03 15:04:15.221137 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 523/1082] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 3 15:04:15 2022] DELETE /compute/v2.1/servers/e5c44b38-0545-41bd-a050-7f8607d179ce => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:04:15.227446 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-aa212d88-3412-47c5-bfa7-f8050b8175b9 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:15.228060 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-aa212d88-3412-47c5-bfa7-f8050b8175b9 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [instance: e5c44b38-0545-41bd-a050-7f8607d179ce] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:15.233932 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-aa212d88-3412-47c5-bfa7-f8050b8175b9 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:15.234417 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-aa212d88-3412-47c5-bfa7-f8050b8175b9 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:15.234854 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-aa212d88-3412-47c5-bfa7-f8050b8175b9 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:15.235548 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-aa212d88-3412-47c5-bfa7-f8050b8175b9 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:15.236001 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-aa212d88-3412-47c5-bfa7-f8050b8175b9 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:15.236425 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-aa212d88-3412-47c5-bfa7-f8050b8175b9 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:15.360372 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-aa212d88-3412-47c5-bfa7-f8050b8175b9 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b3d40ccf454abeb3abda102fe97925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41772d612abc4efa9a7c50a78da63dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:15.367907 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-aa212d88-3412-47c5-bfa7-f8050b8175b9 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] 10.222.0.46 "GET /compute/v2.1/servers/e5c44b38-0545-41bd-a050-7f8607d179ce" status: 200 len: 1504 microversion: 2.1 time: 0.144588 Oct 03 15:04:15.368462 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 560/1083] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:15 2022] GET /compute/v2.1/servers/e5c44b38-0545-41bd-a050-7f8607d179ce => generated 1504 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:16.390448 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-d68393bd-176a-474b-a2f2-074b5e8ccdce tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:16.391073 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-d68393bd-176a-474b-a2f2-074b5e8ccdce tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [instance: e5c44b38-0545-41bd-a050-7f8607d179ce] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:16.398081 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d68393bd-176a-474b-a2f2-074b5e8ccdce tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:16.398567 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d68393bd-176a-474b-a2f2-074b5e8ccdce tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:16.399007 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d68393bd-176a-474b-a2f2-074b5e8ccdce tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:16.399695 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d68393bd-176a-474b-a2f2-074b5e8ccdce tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:16.400154 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d68393bd-176a-474b-a2f2-074b5e8ccdce tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:16.400582 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d68393bd-176a-474b-a2f2-074b5e8ccdce tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:16.532503 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-d68393bd-176a-474b-a2f2-074b5e8ccdce tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b3d40ccf454abeb3abda102fe97925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41772d612abc4efa9a7c50a78da63dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:16.540457 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-d68393bd-176a-474b-a2f2-074b5e8ccdce tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] 10.222.0.46 "GET /compute/v2.1/servers/e5c44b38-0545-41bd-a050-7f8607d179ce" status: 200 len: 1504 microversion: 2.1 time: 0.154298 Oct 03 15:04:16.541034 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 524/1084] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:16 2022] GET /compute/v2.1/servers/e5c44b38-0545-41bd-a050-7f8607d179ce => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:17.270277 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-4ff712f4-0d73-4bb0-95a1-f9deca6470f6 req-47db4d1e-1dc7-4b15-8ed2-5b962cff3cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5c44b38-0545-41bd-a050-7f8607d179ce", "name": "network-vif-deleted", "tag": "422f7fcd-8f8e-4cda-af5a-de109cd906c2"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:04:17.282118 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-4ff712f4-0d73-4bb0-95a1-f9deca6470f6 req-47db4d1e-1dc7-4b15-8ed2-5b962cff3cb1 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:17.282591 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-4ff712f4-0d73-4bb0-95a1-f9deca6470f6 req-47db4d1e-1dc7-4b15-8ed2-5b962cff3cb1 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:17.283020 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-4ff712f4-0d73-4bb0-95a1-f9deca6470f6 req-47db4d1e-1dc7-4b15-8ed2-5b962cff3cb1 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:17.296195 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-4ff712f4-0d73-4bb0-95a1-f9deca6470f6 req-47db4d1e-1dc7-4b15-8ed2-5b962cff3cb1 service nova] Creating event network-vif-deleted:422f7fcd-8f8e-4cda-af5a-de109cd906c2 for instance e5c44b38-0545-41bd-a050-7f8607d179ce on hv-cinder-85987 Oct 03 15:04:17.302697 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-4ff712f4-0d73-4bb0-95a1-f9deca6470f6 req-47db4d1e-1dc7-4b15-8ed2-5b962cff3cb1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035943 Oct 03 15:04:17.303303 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 561/1085] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 15:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:04:17.564702 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-b1c9698d-d5a3-46b4-9b90-acef6c9316b6 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:17.565328 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-b1c9698d-d5a3-46b4-9b90-acef6c9316b6 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [instance: e5c44b38-0545-41bd-a050-7f8607d179ce] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:17.571650 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b1c9698d-d5a3-46b4-9b90-acef6c9316b6 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:17.572132 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b1c9698d-d5a3-46b4-9b90-acef6c9316b6 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:17.572570 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b1c9698d-d5a3-46b4-9b90-acef6c9316b6 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:17.573258 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b1c9698d-d5a3-46b4-9b90-acef6c9316b6 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:17.573740 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b1c9698d-d5a3-46b4-9b90-acef6c9316b6 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:17.574163 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b1c9698d-d5a3-46b4-9b90-acef6c9316b6 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:17.604919 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b1c9698d-d5a3-46b4-9b90-acef6c9316b6 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:17.605391 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b1c9698d-d5a3-46b4-9b90-acef6c9316b6 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:17.605862 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b1c9698d-d5a3-46b4-9b90-acef6c9316b6 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:17.606305 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.objects.instance [None req-b1c9698d-d5a3-46b4-9b90-acef6c9316b6 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lazy-loading 'fault' on Instance uuid e5c44b38-0545-41bd-a050-7f8607d179ce {{(pid=126852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:04:17.645231 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-b1c9698d-d5a3-46b4-9b90-acef6c9316b6 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b3d40ccf454abeb3abda102fe97925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41772d612abc4efa9a7c50a78da63dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:17.652713 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-b1c9698d-d5a3-46b4-9b90-acef6c9316b6 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] 10.222.0.46 "GET /compute/v2.1/servers/e5c44b38-0545-41bd-a050-7f8607d179ce" status: 200 len: 1303 microversion: 2.1 time: 0.091860 Oct 03 15:04:17.653279 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 525/1086] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:17 2022] GET /compute/v2.1/servers/e5c44b38-0545-41bd-a050-7f8607d179ce => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:18.678013 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-fd50891d-b0bf-42e9-a414-8b2469e4188a tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:18.678716 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-fd50891d-b0bf-42e9-a414-8b2469e4188a tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [instance: e5c44b38-0545-41bd-a050-7f8607d179ce] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:18.684814 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fd50891d-b0bf-42e9-a414-8b2469e4188a tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:18.685290 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fd50891d-b0bf-42e9-a414-8b2469e4188a tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:18.685760 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fd50891d-b0bf-42e9-a414-8b2469e4188a tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:18.686448 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fd50891d-b0bf-42e9-a414-8b2469e4188a tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:18.686905 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fd50891d-b0bf-42e9-a414-8b2469e4188a tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:18.687334 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-fd50891d-b0bf-42e9-a414-8b2469e4188a tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:18.700299 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.wsgi [None req-fd50891d-b0bf-42e9-a414-8b2469e4188a tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] HTTP exception thrown: Instance e5c44b38-0545-41bd-a050-7f8607d179ce could not be found. Oct 03 15:04:18.701906 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-fd50891d-b0bf-42e9-a414-8b2469e4188a tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Request method failure captured: Oct 03 15:04:18.701906 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: request: GET /compute/v2.1/servers/e5c44b38-0545-41bd-a050-7f8607d179ce HTTP/1.1 Oct 03 15:04:18.701906 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept: application/json Oct 03 15:04:18.701906 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept-Encoding: identity Oct 03 15:04:18.701906 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Connection: close Oct 03 15:04:18.701906 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Length: 0 Oct 03 15:04:18.701906 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Type: application/json Oct 03 15:04:18.701906 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Host: 10.222.0.46 Oct 03 15:04:18.701906 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Openstack-System-Scope: None Oct 03 15:04:18.701906 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: User-Agent: python-urllib3/1.26.12 Oct 03 15:04:18.701906 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Auth-Token: gAAAAABjOvndGYIdAUQ5aIguZdS4HYP1ZfD3ugvSNiYesUWnh-pl03SL_lS1pT6nF-gTiAKb2iY8uapx1ZEQCAP-YMjNK4b7pSIFKfosyugscPnvCUraltlEbvLiJo_PZy7B183re5Bh5B2tjUo09mbASUwwc68bin2XXCf1e7BjRfMWJ7awtIc Oct 03 15:04:18.701906 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Id: None Oct 03 15:04:18.701906 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Name: None Oct 03 15:04:18.701906 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Identity-Status: Confirmed Oct 03 15:04:18.701906 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Is-Admin-Project: True Oct 03 15:04:18.701906 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Id: default Oct 03 15:04:18.701906 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Name: Default Oct 03 15:04:18.701906 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Id: 41772d612abc4efa9a7c50a78da63dce Oct 03 15:04:18.701906 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Name: tempest-VolumesActionsTest-783709317 Oct 03 15:04:18.701906 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Role: member,reader Oct 03 15:04:18.701906 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Roles: member,reader Oct 03 15:04:18.703590 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/41772d612abc4efa9a7c50a78da63dce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_41772d612abc4efa9a7c50a78da63dce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/41772d612abc4efa9a7c50a78da63dce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/41772d612abc4efa9a7c50a78da63dce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 15:04:18.703590 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant: tempest-VolumesActionsTest-783709317 Oct 03 15:04:18.703590 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Id: 41772d612abc4efa9a7c50a78da63dce Oct 03 15:04:18.703590 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Name: tempest-VolumesActionsTest-783709317 Oct 03 15:04:18.703590 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User: tempest-VolumesActionsTest-783709317-project Oct 03 15:04:18.703590 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Id: default Oct 03 15:04:18.703590 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Name: Default Oct 03 15:04:18.703590 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Id: 44b3d40ccf454abeb3abda102fe97925 Oct 03 15:04:18.703590 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Name: tempest-VolumesActionsTest-783709317-project Oct 03 15:04:18.703590 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: method: > Oct 03 15:04:18.703590 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: exception: Instance e5c44b38-0545-41bd-a050-7f8607d179ce could not be found. Oct 03 15:04:18.703590 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: action_args: {'id': 'e5c44b38-0545-41bd-a050-7f8607d179ce'} Oct 03 15:04:18.704468 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:04:18.704468 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:04:18.704468 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:04:18.704468 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:04:18.704468 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:04:18.704468 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:04:18.704468 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:04:18.704468 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:04:18.704468 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:04:18.704468 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:04:18.704468 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5c44b38-0545-41bd-a050-7f8607d179ce could not be found. Oct 03 15:04:18.704468 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:04:18.704468 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:04:18.704468 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:04:18.704468 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:04:18.704468 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:04:18.704468 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:04:18.704468 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:04:18.704468 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:04:18.704468 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:04:18.705846 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:04:18.705846 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:04:18.705846 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:04:18.705846 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:04:18.705846 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:04:18.705846 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:04:18.705846 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:04:18.705846 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5c44b38-0545-41bd-a050-7f8607d179ce could not be found. Oct 03 15:04:18.705846 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:04:18.705846 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:04:18.705846 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:04:18.705846 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:04:18.705846 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:04:18.705846 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:04:18.705846 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:04:18.705846 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:04:18.705846 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5c44b38-0545-41bd-a050-7f8607d179ce could not be found. Oct 03 15:04:18.705846 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:04:18.707010 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-fd50891d-b0bf-42e9-a414-8b2469e4188a tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Returning 404 to user: Instance e5c44b38-0545-41bd-a050-7f8607d179ce could not be found. {{(pid=126851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:04:18.707010 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-fd50891d-b0bf-42e9-a414-8b2469e4188a tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] 10.222.0.46 "GET /compute/v2.1/servers/e5c44b38-0545-41bd-a050-7f8607d179ce" status: 404 len: 111 microversion: 2.1 time: 0.030720 Oct 03 15:04:18.707010 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 562/1087] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:18 2022] GET /compute/v2.1/servers/e5c44b38-0545-41bd-a050-7f8607d179ce => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:04:18.798561 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-dd172350-0bcf-4590-b2ab-07a3253b295d tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2140548726", "imageRef": "add7a872-2ca1-4366-9a93-f0663fdb297b", "flavorRef": "452", "networks": [{"uuid": "6dfe7b06-6ddf-4afa-a9b3-ca0f8f68c45a"}]}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:04:18.851639 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.network.neutron [None req-dd172350-0bcf-4590-b2ab-07a3253b295d tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] validate_networks() for [('6dfe7b06-6ddf-4afa-a9b3-ca0f8f68c45a', None, None, None, None, None)] {{(pid=126852) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:04:19.189352 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-dd172350-0bcf-4590-b2ab-07a3253b295d tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Flavor limits 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:04:19.189854 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-dd172350-0bcf-4590-b2ab-07a3253b295d tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Image limits 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:04:19.190328 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-dd172350-0bcf-4590-b2ab-07a3253b295d tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Flavor pref 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:04:19.191353 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-dd172350-0bcf-4590-b2ab-07a3253b295d tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Image pref 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:04:19.191761 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-dd172350-0bcf-4590-b2ab-07a3253b295d tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:04:19.200546 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-dd172350-0bcf-4590-b2ab-07a3253b295d tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:19.201022 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-dd172350-0bcf-4590-b2ab-07a3253b295d tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:19.201463 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-dd172350-0bcf-4590-b2ab-07a3253b295d tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:19.202204 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-dd172350-0bcf-4590-b2ab-07a3253b295d tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:19.202654 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-dd172350-0bcf-4590-b2ab-07a3253b295d tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:19.203073 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-dd172350-0bcf-4590-b2ab-07a3253b295d tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:19.219259 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-dd172350-0bcf-4590-b2ab-07a3253b295d tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Getting quotas for project 41772d612abc4efa9a7c50a78da63dce. Resources: {'ram', 'instances', 'cores'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:04:19.223081 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-dd172350-0bcf-4590-b2ab-07a3253b295d tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Getting quotas for user 44b3d40ccf454abeb3abda102fe97925 and project 41772d612abc4efa9a7c50a78da63dce. Resources: {'ram', 'instances', 'cores'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:04:19.233669 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-dd172350-0bcf-4590-b2ab-07a3253b295d tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Going to run 1 instances... {{(pid=126852) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:04:19.235898 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-dd172350-0bcf-4590-b2ab-07a3253b295d tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [instance: 1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='add7a872-2ca1-4366-9a93-f0663fdb297b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:04:19.280634 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-dd172350-0bcf-4590-b2ab-07a3253b295d tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.485849 Oct 03 15:04:19.281491 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 526/1088] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 3 15:04:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:04:19.292204 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-cf0b9271-bd4b-4af9-8cb4-d82467b43c6c tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:19.292815 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-cf0b9271-bd4b-4af9-8cb4-d82467b43c6c tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [instance: 1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:19.355991 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-cf0b9271-bd4b-4af9-8cb4-d82467b43c6c tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b3d40ccf454abeb3abda102fe97925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41772d612abc4efa9a7c50a78da63dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:19.363504 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-cf0b9271-bd4b-4af9-8cb4-d82467b43c6c tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] 10.222.0.46 "GET /compute/v2.1/servers/1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743" status: 200 len: 1214 microversion: 2.1 time: 0.075090 Oct 03 15:04:19.364068 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 563/1089] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:19 2022] GET /compute/v2.1/servers/1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743 => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:20.386975 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-b317ecb2-a8ac-4a2f-9069-8dc6e47f68e9 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:20.388202 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-b317ecb2-a8ac-4a2f-9069-8dc6e47f68e9 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [instance: 1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:20.395754 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b317ecb2-a8ac-4a2f-9069-8dc6e47f68e9 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:20.396243 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b317ecb2-a8ac-4a2f-9069-8dc6e47f68e9 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:20.396864 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b317ecb2-a8ac-4a2f-9069-8dc6e47f68e9 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:20.397634 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b317ecb2-a8ac-4a2f-9069-8dc6e47f68e9 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:20.398146 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b317ecb2-a8ac-4a2f-9069-8dc6e47f68e9 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:20.398645 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-b317ecb2-a8ac-4a2f-9069-8dc6e47f68e9 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:20.464222 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-b317ecb2-a8ac-4a2f-9069-8dc6e47f68e9 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b3d40ccf454abeb3abda102fe97925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41772d612abc4efa9a7c50a78da63dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:20.471968 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-b317ecb2-a8ac-4a2f-9069-8dc6e47f68e9 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] 10.222.0.46 "GET /compute/v2.1/servers/1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743" status: 200 len: 1272 microversion: 2.1 time: 0.089662 Oct 03 15:04:20.472532 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 527/1090] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:20 2022] GET /compute/v2.1/servers/1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743 => generated 1272 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:21.493653 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-8b2f3e69-0c3e-4e22-9e3c-b506b9c54451 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:21.494269 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-8b2f3e69-0c3e-4e22-9e3c-b506b9c54451 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [instance: 1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:21.501427 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8b2f3e69-0c3e-4e22-9e3c-b506b9c54451 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:21.501954 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8b2f3e69-0c3e-4e22-9e3c-b506b9c54451 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:21.502389 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8b2f3e69-0c3e-4e22-9e3c-b506b9c54451 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:21.503079 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8b2f3e69-0c3e-4e22-9e3c-b506b9c54451 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:21.503537 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8b2f3e69-0c3e-4e22-9e3c-b506b9c54451 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:21.503991 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8b2f3e69-0c3e-4e22-9e3c-b506b9c54451 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:21.645386 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-b25f8300-6c34-4491-836f-9466900d4a4f req-13e6fd65-64c0-4159-914d-86b564c02428 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743", "tag": "4333c995-01c5-4e6e-9a71-18bc1c1f647f"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:04:21.655388 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-b25f8300-6c34-4491-836f-9466900d4a4f req-13e6fd65-64c0-4159-914d-86b564c02428 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:21.655869 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-b25f8300-6c34-4491-836f-9466900d4a4f req-13e6fd65-64c0-4159-914d-86b564c02428 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:21.656296 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-b25f8300-6c34-4491-836f-9466900d4a4f req-13e6fd65-64c0-4159-914d-86b564c02428 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:21.667606 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-b25f8300-6c34-4491-836f-9466900d4a4f req-13e6fd65-64c0-4159-914d-86b564c02428 service nova] Creating event network-changed:4333c995-01c5-4e6e-9a71-18bc1c1f647f for instance 1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743 on hv-cinder-85987 Oct 03 15:04:21.672906 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-b25f8300-6c34-4491-836f-9466900d4a4f req-13e6fd65-64c0-4159-914d-86b564c02428 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032047 Oct 03 15:04:21.673527 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 528/1091] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 15:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:04:21.714904 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-8b2f3e69-0c3e-4e22-9e3c-b506b9c54451 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b3d40ccf454abeb3abda102fe97925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41772d612abc4efa9a7c50a78da63dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:21.724068 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-8b2f3e69-0c3e-4e22-9e3c-b506b9c54451 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] 10.222.0.46 "GET /compute/v2.1/servers/1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743" status: 200 len: 1314 microversion: 2.1 time: 0.234274 Oct 03 15:04:21.731683 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 564/1092] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:21 2022] GET /compute/v2.1/servers/1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:22.747576 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-5a145117-b595-4553-b3d5-2cac407a2226 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:22.748271 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-5a145117-b595-4553-b3d5-2cac407a2226 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [instance: 1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:22.755096 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5a145117-b595-4553-b3d5-2cac407a2226 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:22.755587 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5a145117-b595-4553-b3d5-2cac407a2226 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:22.756022 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5a145117-b595-4553-b3d5-2cac407a2226 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:22.756708 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5a145117-b595-4553-b3d5-2cac407a2226 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:22.757158 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5a145117-b595-4553-b3d5-2cac407a2226 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:22.757604 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5a145117-b595-4553-b3d5-2cac407a2226 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:22.885790 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-5a145117-b595-4553-b3d5-2cac407a2226 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b3d40ccf454abeb3abda102fe97925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41772d612abc4efa9a7c50a78da63dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:22.893261 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-5a145117-b595-4553-b3d5-2cac407a2226 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] 10.222.0.46 "GET /compute/v2.1/servers/1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743" status: 200 len: 1314 microversion: 2.1 time: 0.149826 Oct 03 15:04:22.894360 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 529/1093] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:22 2022] GET /compute/v2.1/servers/1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:23.916256 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-39527d25-302e-4f9d-bc52-fc32efbdb37e tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:23.916860 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-39527d25-302e-4f9d-bc52-fc32efbdb37e tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [instance: 1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:23.923235 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-39527d25-302e-4f9d-bc52-fc32efbdb37e tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:23.923715 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-39527d25-302e-4f9d-bc52-fc32efbdb37e tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:23.924145 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-39527d25-302e-4f9d-bc52-fc32efbdb37e tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:23.924873 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-39527d25-302e-4f9d-bc52-fc32efbdb37e tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:23.925928 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-39527d25-302e-4f9d-bc52-fc32efbdb37e tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:23.926350 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-39527d25-302e-4f9d-bc52-fc32efbdb37e tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:24.354100 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-39527d25-302e-4f9d-bc52-fc32efbdb37e tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b3d40ccf454abeb3abda102fe97925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41772d612abc4efa9a7c50a78da63dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:24.362183 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-39527d25-302e-4f9d-bc52-fc32efbdb37e tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] 10.222.0.46 "GET /compute/v2.1/servers/1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743" status: 200 len: 1314 microversion: 2.1 time: 0.449239 Oct 03 15:04:24.362183 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 565/1094] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:23 2022] GET /compute/v2.1/servers/1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743 => generated 1314 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:25.384540 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-a69497d1-ae00-4c36-ab2e-c88e5d0690ea tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:25.385241 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-a69497d1-ae00-4c36-ab2e-c88e5d0690ea tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [instance: 1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:25.391757 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a69497d1-ae00-4c36-ab2e-c88e5d0690ea tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:25.392240 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a69497d1-ae00-4c36-ab2e-c88e5d0690ea tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:25.392678 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a69497d1-ae00-4c36-ab2e-c88e5d0690ea tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:25.393361 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a69497d1-ae00-4c36-ab2e-c88e5d0690ea tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:25.394463 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a69497d1-ae00-4c36-ab2e-c88e5d0690ea tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:25.394888 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-a69497d1-ae00-4c36-ab2e-c88e5d0690ea tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:25.521802 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-a69497d1-ae00-4c36-ab2e-c88e5d0690ea tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b3d40ccf454abeb3abda102fe97925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41772d612abc4efa9a7c50a78da63dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:25.529274 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-a69497d1-ae00-4c36-ab2e-c88e5d0690ea tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] 10.222.0.46 "GET /compute/v2.1/servers/1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743" status: 200 len: 1314 microversion: 2.1 time: 0.148602 Oct 03 15:04:25.529983 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 530/1095] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:25 2022] GET /compute/v2.1/servers/1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:26.552635 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-1b541b83-bed7-449a-9d4c-87804067608c tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:26.553238 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-1b541b83-bed7-449a-9d4c-87804067608c tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [instance: 1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:26.559643 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1b541b83-bed7-449a-9d4c-87804067608c tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:26.560097 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1b541b83-bed7-449a-9d4c-87804067608c tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:26.560526 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1b541b83-bed7-449a-9d4c-87804067608c tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:26.561206 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1b541b83-bed7-449a-9d4c-87804067608c tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:26.561802 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1b541b83-bed7-449a-9d4c-87804067608c tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:26.562230 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1b541b83-bed7-449a-9d4c-87804067608c tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:26.689940 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-1b541b83-bed7-449a-9d4c-87804067608c tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b3d40ccf454abeb3abda102fe97925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41772d612abc4efa9a7c50a78da63dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:26.698082 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-1b541b83-bed7-449a-9d4c-87804067608c tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] 10.222.0.46 "GET /compute/v2.1/servers/1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743" status: 200 len: 1314 microversion: 2.1 time: 0.149805 Oct 03 15:04:26.698639 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 566/1096] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:26 2022] GET /compute/v2.1/servers/1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:27.720354 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-d8a27b6e-f620-4dfa-9d74-4659d14a5185 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:27.720963 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-d8a27b6e-f620-4dfa-9d74-4659d14a5185 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [instance: 1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:27.727517 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d8a27b6e-f620-4dfa-9d74-4659d14a5185 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:27.727998 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d8a27b6e-f620-4dfa-9d74-4659d14a5185 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:27.728427 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d8a27b6e-f620-4dfa-9d74-4659d14a5185 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:27.729104 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d8a27b6e-f620-4dfa-9d74-4659d14a5185 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:27.729576 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d8a27b6e-f620-4dfa-9d74-4659d14a5185 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:27.730003 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d8a27b6e-f620-4dfa-9d74-4659d14a5185 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:27.859451 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-d8a27b6e-f620-4dfa-9d74-4659d14a5185 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b3d40ccf454abeb3abda102fe97925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41772d612abc4efa9a7c50a78da63dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:27.867109 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-d8a27b6e-f620-4dfa-9d74-4659d14a5185 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] 10.222.0.46 "GET /compute/v2.1/servers/1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743" status: 200 len: 1314 microversion: 2.1 time: 0.150581 Oct 03 15:04:27.867677 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 531/1097] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:27 2022] GET /compute/v2.1/servers/1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:28.352901 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-a4da2e65-c8c4-4078-a110-a5d31142bccc req-31807f07-0bc6-4887-945d-64dd17887c3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743", "name": "network-vif-plugged", "status": "completed", "tag": "4333c995-01c5-4e6e-9a71-18bc1c1f647f"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:04:28.363890 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-a4da2e65-c8c4-4078-a110-a5d31142bccc req-31807f07-0bc6-4887-945d-64dd17887c3c service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:28.364385 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-a4da2e65-c8c4-4078-a110-a5d31142bccc req-31807f07-0bc6-4887-945d-64dd17887c3c service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:28.364815 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-a4da2e65-c8c4-4078-a110-a5d31142bccc req-31807f07-0bc6-4887-945d-64dd17887c3c service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:28.375744 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-a4da2e65-c8c4-4078-a110-a5d31142bccc req-31807f07-0bc6-4887-945d-64dd17887c3c service nova] Creating event network-vif-plugged:4333c995-01c5-4e6e-9a71-18bc1c1f647f for instance 1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743 on hv-cinder-85987 Oct 03 15:04:28.380605 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-a4da2e65-c8c4-4078-a110-a5d31142bccc req-31807f07-0bc6-4887-945d-64dd17887c3c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031423 Oct 03 15:04:28.381197 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 567/1098] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 15:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:04:28.890257 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-0d274a15-4b1b-4264-983c-3c171e84f86e tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:28.890808 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-0d274a15-4b1b-4264-983c-3c171e84f86e tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [instance: 1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:28.893164 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:04:28.899354 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0d274a15-4b1b-4264-983c-3c171e84f86e tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:28.899839 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0d274a15-4b1b-4264-983c-3c171e84f86e tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:28.900275 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0d274a15-4b1b-4264-983c-3c171e84f86e tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:28.900962 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0d274a15-4b1b-4264-983c-3c171e84f86e tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:28.901419 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0d274a15-4b1b-4264-983c-3c171e84f86e tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:28.901868 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0d274a15-4b1b-4264-983c-3c171e84f86e tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:28.904877 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:04:29.031786 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-0d274a15-4b1b-4264-983c-3c171e84f86e tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b3d40ccf454abeb3abda102fe97925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41772d612abc4efa9a7c50a78da63dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:29.040059 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-0d274a15-4b1b-4264-983c-3c171e84f86e tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] 10.222.0.46 "GET /compute/v2.1/servers/1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743" status: 200 len: 1314 microversion: 2.1 time: 0.153666 Oct 03 15:04:29.040633 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 532/1099] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:28 2022] GET /compute/v2.1/servers/1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:30.060837 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell0:SELECT=2 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:04:30.064902 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-ab671c72-c8d6-4e01-b0b3-8018145a33af tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:30.065641 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-ab671c72-c8d6-4e01-b0b3-8018145a33af tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [instance: 1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:30.072042 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ab671c72-c8d6-4e01-b0b3-8018145a33af tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:30.072526 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ab671c72-c8d6-4e01-b0b3-8018145a33af tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:30.072962 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ab671c72-c8d6-4e01-b0b3-8018145a33af tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:30.073689 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ab671c72-c8d6-4e01-b0b3-8018145a33af tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:30.074148 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ab671c72-c8d6-4e01-b0b3-8018145a33af tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:30.074572 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ab671c72-c8d6-4e01-b0b3-8018145a33af tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:30.211733 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-ab671c72-c8d6-4e01-b0b3-8018145a33af tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b3d40ccf454abeb3abda102fe97925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41772d612abc4efa9a7c50a78da63dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:30.219285 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-ab671c72-c8d6-4e01-b0b3-8018145a33af tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] 10.222.0.46 "GET /compute/v2.1/servers/1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743" status: 200 len: 1314 microversion: 2.1 time: 0.159862 Oct 03 15:04:30.219848 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 568/1100] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:30 2022] GET /compute/v2.1/servers/1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:31.242802 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-5c35040d-694a-4edf-a766-972f04097a4c tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:31.243451 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-5c35040d-694a-4edf-a766-972f04097a4c tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [instance: 1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:31.245262 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell0:SELECT=2 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:04:31.245969 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell0:SELECT=6 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:04:31.252628 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5c35040d-694a-4edf-a766-972f04097a4c tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:31.253750 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5c35040d-694a-4edf-a766-972f04097a4c tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:31.254195 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5c35040d-694a-4edf-a766-972f04097a4c tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:31.254896 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5c35040d-694a-4edf-a766-972f04097a4c tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:31.255351 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5c35040d-694a-4edf-a766-972f04097a4c tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:31.255774 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5c35040d-694a-4edf-a766-972f04097a4c tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:31.385975 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-5c35040d-694a-4edf-a766-972f04097a4c tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b3d40ccf454abeb3abda102fe97925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41772d612abc4efa9a7c50a78da63dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:31.393669 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-5c35040d-694a-4edf-a766-972f04097a4c tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] 10.222.0.46 "GET /compute/v2.1/servers/1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743" status: 200 len: 1498 microversion: 2.1 time: 0.154693 Oct 03 15:04:31.394283 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 533/1101] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:31 2022] GET /compute/v2.1/servers/1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743 => generated 1498 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:31.916295 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-f8eff9cf-73d8-49d2-b8bc-44b4fd09ce33 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:31.916797 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-f8eff9cf-73d8-49d2-b8bc-44b4fd09ce33 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [instance: 1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:31.920220 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_api:SELECT=39 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:04:31.924266 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f8eff9cf-73d8-49d2-b8bc-44b4fd09ce33 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:31.924760 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f8eff9cf-73d8-49d2-b8bc-44b4fd09ce33 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:31.925200 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f8eff9cf-73d8-49d2-b8bc-44b4fd09ce33 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:31.925938 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f8eff9cf-73d8-49d2-b8bc-44b4fd09ce33 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:31.926402 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f8eff9cf-73d8-49d2-b8bc-44b4fd09ce33 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:31.926830 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f8eff9cf-73d8-49d2-b8bc-44b4fd09ce33 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:31.931038 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=75 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:04:31.952785 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-f8eff9cf-73d8-49d2-b8bc-44b4fd09ce33 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [instance: 1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743] Going to try to terminate instance {{(pid=126851) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:04:32.031260 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-f8eff9cf-73d8-49d2-b8bc-44b4fd09ce33 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743" status: 204 len: 0 microversion: 2.1 time: 0.118149 Oct 03 15:04:32.032126 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 569/1102] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 3 15:04:31 2022] DELETE /compute/v2.1/servers/1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:04:32.041699 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-2eb04606-8615-4bee-a633-d207863e2472 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:32.042511 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-2eb04606-8615-4bee-a633-d207863e2472 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [instance: 1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:32.048710 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2eb04606-8615-4bee-a633-d207863e2472 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:32.049198 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2eb04606-8615-4bee-a633-d207863e2472 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:32.049696 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2eb04606-8615-4bee-a633-d207863e2472 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:32.050445 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2eb04606-8615-4bee-a633-d207863e2472 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:32.051020 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2eb04606-8615-4bee-a633-d207863e2472 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:32.051450 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2eb04606-8615-4bee-a633-d207863e2472 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:32.182322 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-2eb04606-8615-4bee-a633-d207863e2472 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b3d40ccf454abeb3abda102fe97925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41772d612abc4efa9a7c50a78da63dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:32.189898 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-2eb04606-8615-4bee-a633-d207863e2472 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] 10.222.0.46 "GET /compute/v2.1/servers/1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743" status: 200 len: 1504 microversion: 2.1 time: 0.152310 Oct 03 15:04:32.191005 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 534/1103] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:32 2022] GET /compute/v2.1/servers/1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:33.214066 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-c957ad0e-0a7c-4a3a-a065-273210fb4750 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:33.214773 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-c957ad0e-0a7c-4a3a-a065-273210fb4750 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [instance: 1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:33.221121 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c957ad0e-0a7c-4a3a-a065-273210fb4750 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:33.221646 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c957ad0e-0a7c-4a3a-a065-273210fb4750 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:33.222697 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c957ad0e-0a7c-4a3a-a065-273210fb4750 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:33.223396 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c957ad0e-0a7c-4a3a-a065-273210fb4750 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:33.223852 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c957ad0e-0a7c-4a3a-a065-273210fb4750 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:33.224282 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c957ad0e-0a7c-4a3a-a065-273210fb4750 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:33.355144 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-c957ad0e-0a7c-4a3a-a065-273210fb4750 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b3d40ccf454abeb3abda102fe97925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41772d612abc4efa9a7c50a78da63dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:33.362876 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-c957ad0e-0a7c-4a3a-a065-273210fb4750 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] 10.222.0.46 "GET /compute/v2.1/servers/1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743" status: 200 len: 1504 microversion: 2.1 time: 0.153070 Oct 03 15:04:33.363436 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 570/1104] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:33 2022] GET /compute/v2.1/servers/1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:34.039867 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-5bc037fe-5e4c-4a93-9e37-c6b83fcb5a72 req-fbc63978-e89e-41a0-8d0d-928360e1c9ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743", "name": "network-vif-deleted", "tag": "4333c995-01c5-4e6e-9a71-18bc1c1f647f"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:04:34.052064 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-5bc037fe-5e4c-4a93-9e37-c6b83fcb5a72 req-fbc63978-e89e-41a0-8d0d-928360e1c9ab service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:34.052538 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-5bc037fe-5e4c-4a93-9e37-c6b83fcb5a72 req-fbc63978-e89e-41a0-8d0d-928360e1c9ab service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:34.052967 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-5bc037fe-5e4c-4a93-9e37-c6b83fcb5a72 req-fbc63978-e89e-41a0-8d0d-928360e1c9ab service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:34.064938 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-5bc037fe-5e4c-4a93-9e37-c6b83fcb5a72 req-fbc63978-e89e-41a0-8d0d-928360e1c9ab service nova] Creating event network-vif-deleted:4333c995-01c5-4e6e-9a71-18bc1c1f647f for instance 1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743 on hv-cinder-85987 Oct 03 15:04:34.070932 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-5bc037fe-5e4c-4a93-9e37-c6b83fcb5a72 req-fbc63978-e89e-41a0-8d0d-928360e1c9ab service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034753 Oct 03 15:04:34.071518 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 535/1105] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 15:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:04:34.385832 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-8a0a20e1-071a-454c-a676-36c5d91e6253 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:34.386440 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-8a0a20e1-071a-454c-a676-36c5d91e6253 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [instance: 1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:34.392830 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8a0a20e1-071a-454c-a676-36c5d91e6253 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:34.393312 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8a0a20e1-071a-454c-a676-36c5d91e6253 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:34.393865 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8a0a20e1-071a-454c-a676-36c5d91e6253 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:34.394612 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8a0a20e1-071a-454c-a676-36c5d91e6253 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:34.395066 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8a0a20e1-071a-454c-a676-36c5d91e6253 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:34.395521 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8a0a20e1-071a-454c-a676-36c5d91e6253 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:34.427170 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8a0a20e1-071a-454c-a676-36c5d91e6253 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:34.427887 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8a0a20e1-071a-454c-a676-36c5d91e6253 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:34.428356 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8a0a20e1-071a-454c-a676-36c5d91e6253 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:34.429013 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.objects.instance [None req-8a0a20e1-071a-454c-a676-36c5d91e6253 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lazy-loading 'fault' on Instance uuid 1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743 {{(pid=126851) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:04:34.469239 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-8a0a20e1-071a-454c-a676-36c5d91e6253 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b3d40ccf454abeb3abda102fe97925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41772d612abc4efa9a7c50a78da63dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:34.477874 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-8a0a20e1-071a-454c-a676-36c5d91e6253 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] 10.222.0.46 "GET /compute/v2.1/servers/1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743" status: 200 len: 1304 microversion: 2.1 time: 0.095966 Oct 03 15:04:34.478433 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 571/1106] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:34 2022] GET /compute/v2.1/servers/1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:35.502709 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-9dc62492-f11c-4760-b75b-f0532369d806 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:35.503935 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-9dc62492-f11c-4760-b75b-f0532369d806 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] [instance: 1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:35.509994 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9dc62492-f11c-4760-b75b-f0532369d806 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:35.510469 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9dc62492-f11c-4760-b75b-f0532369d806 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:35.510897 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9dc62492-f11c-4760-b75b-f0532369d806 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:35.511579 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9dc62492-f11c-4760-b75b-f0532369d806 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:35.512031 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9dc62492-f11c-4760-b75b-f0532369d806 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:35.512455 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9dc62492-f11c-4760-b75b-f0532369d806 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:35.525271 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.wsgi [None req-9dc62492-f11c-4760-b75b-f0532369d806 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] HTTP exception thrown: Instance 1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743 could not be found. Oct 03 15:04:35.526885 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-9dc62492-f11c-4760-b75b-f0532369d806 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Request method failure captured: Oct 03 15:04:35.526885 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: request: GET /compute/v2.1/servers/1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743 HTTP/1.1 Oct 03 15:04:35.526885 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept: application/json Oct 03 15:04:35.526885 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept-Encoding: identity Oct 03 15:04:35.526885 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Connection: close Oct 03 15:04:35.526885 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Length: 0 Oct 03 15:04:35.526885 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Type: application/json Oct 03 15:04:35.526885 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Host: 10.222.0.46 Oct 03 15:04:35.526885 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Openstack-System-Scope: None Oct 03 15:04:35.526885 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: User-Agent: python-urllib3/1.26.12 Oct 03 15:04:35.526885 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Auth-Token: gAAAAABjOvndGYIdAUQ5aIguZdS4HYP1ZfD3ugvSNiYesUWnh-pl03SL_lS1pT6nF-gTiAKb2iY8uapx1ZEQCAP-YMjNK4b7pSIFKfosyugscPnvCUraltlEbvLiJo_PZy7B183re5Bh5B2tjUo09mbASUwwc68bin2XXCf1e7BjRfMWJ7awtIc Oct 03 15:04:35.526885 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Id: None Oct 03 15:04:35.526885 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Name: None Oct 03 15:04:35.526885 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Identity-Status: Confirmed Oct 03 15:04:35.526885 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Is-Admin-Project: True Oct 03 15:04:35.526885 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Id: default Oct 03 15:04:35.526885 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Name: Default Oct 03 15:04:35.526885 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Id: 41772d612abc4efa9a7c50a78da63dce Oct 03 15:04:35.526885 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Name: tempest-VolumesActionsTest-783709317 Oct 03 15:04:35.526885 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Role: member,reader Oct 03 15:04:35.526885 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Roles: member,reader Oct 03 15:04:35.528596 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/41772d612abc4efa9a7c50a78da63dce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_41772d612abc4efa9a7c50a78da63dce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/41772d612abc4efa9a7c50a78da63dce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/41772d612abc4efa9a7c50a78da63dce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 15:04:35.528596 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant: tempest-VolumesActionsTest-783709317 Oct 03 15:04:35.528596 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Id: 41772d612abc4efa9a7c50a78da63dce Oct 03 15:04:35.528596 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Name: tempest-VolumesActionsTest-783709317 Oct 03 15:04:35.528596 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User: tempest-VolumesActionsTest-783709317-project Oct 03 15:04:35.528596 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Id: default Oct 03 15:04:35.528596 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Name: Default Oct 03 15:04:35.528596 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Id: 44b3d40ccf454abeb3abda102fe97925 Oct 03 15:04:35.528596 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Name: tempest-VolumesActionsTest-783709317-project Oct 03 15:04:35.528596 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: method: > Oct 03 15:04:35.528596 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: exception: Instance 1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743 could not be found. Oct 03 15:04:35.528596 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: action_args: {'id': '1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743'} Oct 03 15:04:35.529547 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:04:35.529547 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:04:35.529547 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:04:35.529547 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:04:35.529547 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:04:35.529547 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:04:35.529547 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:04:35.529547 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:04:35.529547 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:04:35.529547 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:04:35.529547 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743 could not be found. Oct 03 15:04:35.529547 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:04:35.529547 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:04:35.529547 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:04:35.529547 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:04:35.529547 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:04:35.529547 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:04:35.529547 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:04:35.529547 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:04:35.529547 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:04:35.531209 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:04:35.531209 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:04:35.531209 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:04:35.531209 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:04:35.531209 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:04:35.531209 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:04:35.531209 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:04:35.531209 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743 could not be found. Oct 03 15:04:35.531209 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:04:35.531209 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:04:35.531209 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:04:35.531209 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:04:35.531209 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:04:35.531209 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:04:35.531209 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:04:35.531209 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:04:35.531209 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743 could not be found. Oct 03 15:04:35.531209 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:04:35.532816 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-9dc62492-f11c-4760-b75b-f0532369d806 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] Returning 404 to user: Instance 1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743 could not be found. {{(pid=126852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:04:35.532816 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-9dc62492-f11c-4760-b75b-f0532369d806 tempest-VolumesActionsTest-783709317 tempest-VolumesActionsTest-783709317-project] 10.222.0.46 "GET /compute/v2.1/servers/1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743" status: 404 len: 111 microversion: 2.1 time: 0.030330 Oct 03 15:04:35.532816 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 536/1107] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:35 2022] GET /compute/v2.1/servers/1eb2f7f6-ae4a-4bd6-9417-8b4f5c4e5743 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:05:02.049742 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-76f598f1-7e26-47fa-8490-3497fcfc7f8a tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-299877246", "imageRef": "add7a872-2ca1-4366-9a93-f0663fdb297b", "flavorRef": "452", "networks": [{"uuid": "e829d98a-e29f-45ac-9a33-fac7c75b7c82"}]}} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:05:02.058386 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:05:02.059026 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:05:02.107085 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.network.neutron [None req-76f598f1-7e26-47fa-8490-3497fcfc7f8a tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] validate_networks() for [('e829d98a-e29f-45ac-9a33-fac7c75b7c82', None, None, None, None, None)] {{(pid=126851) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:05:02.504325 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-76f598f1-7e26-47fa-8490-3497fcfc7f8a tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Flavor limits 0:0:0 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:05:02.504742 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-76f598f1-7e26-47fa-8490-3497fcfc7f8a tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Image limits 0:0:0 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:05:02.505210 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-76f598f1-7e26-47fa-8490-3497fcfc7f8a tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Flavor pref 0:0:0 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:05:02.505649 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-76f598f1-7e26-47fa-8490-3497fcfc7f8a tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Image pref 0:0:0 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:05:02.506058 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.virt.hardware [None req-76f598f1-7e26-47fa-8490-3497fcfc7f8a tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:05:02.514633 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-76f598f1-7e26-47fa-8490-3497fcfc7f8a tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:02.515107 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-76f598f1-7e26-47fa-8490-3497fcfc7f8a tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:02.515538 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-76f598f1-7e26-47fa-8490-3497fcfc7f8a tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:02.516258 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-76f598f1-7e26-47fa-8490-3497fcfc7f8a tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:02.516709 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-76f598f1-7e26-47fa-8490-3497fcfc7f8a tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:02.517129 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-76f598f1-7e26-47fa-8490-3497fcfc7f8a tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:02.533641 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.quota [None req-76f598f1-7e26-47fa-8490-3497fcfc7f8a tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Getting quotas for project cf939187436d4978a7805ab5aa91005a. Resources: {'ram', 'instances', 'cores'} {{(pid=126851) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:05:02.538050 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.quota [None req-76f598f1-7e26-47fa-8490-3497fcfc7f8a tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Getting quotas for user fba9bc42ba834887a018ea2b50fcf862 and project cf939187436d4978a7805ab5aa91005a. Resources: {'ram', 'instances', 'cores'} {{(pid=126851) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:05:02.548529 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-76f598f1-7e26-47fa-8490-3497fcfc7f8a tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Going to run 1 instances... {{(pid=126851) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:05:02.550810 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-76f598f1-7e26-47fa-8490-3497fcfc7f8a tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 41a92c14-7874-4e53-b1e6-46331b3d2ca4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='add7a872-2ca1-4366-9a93-f0663fdb297b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126851) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:05:02.596735 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-76f598f1-7e26-47fa-8490-3497fcfc7f8a tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.550920 Oct 03 15:05:02.598013 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 572/1108] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 3 15:05:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:05:02.609982 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-3d2779a9-cf29-4aeb-bf05-e2bd1a76a79d tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:02.610704 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-3d2779a9-cf29-4aeb-bf05-e2bd1a76a79d tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 41a92c14-7874-4e53-b1e6-46331b3d2ca4] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:02.615048 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_api:SELECT=9 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:05:02.615759 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=21 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:05:02.667043 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-3d2779a9-cf29-4aeb-bf05-e2bd1a76a79d tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba9bc42ba834887a018ea2b50fcf862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf939187436d4978a7805ab5aa91005a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:02.673975 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-3d2779a9-cf29-4aeb-bf05-e2bd1a76a79d tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] 10.222.0.46 "GET /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4" status: 200 len: 1218 microversion: 2.1 time: 0.067988 Oct 03 15:05:02.674497 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 537/1109] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:02 2022] GET /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4 => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:05:03.697809 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-2253bacc-12a4-45e1-9034-1e1a6cae7352 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:03.699166 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-2253bacc-12a4-45e1-9034-1e1a6cae7352 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 41a92c14-7874-4e53-b1e6-46331b3d2ca4] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:03.706009 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2253bacc-12a4-45e1-9034-1e1a6cae7352 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:03.707276 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2253bacc-12a4-45e1-9034-1e1a6cae7352 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:03.708406 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2253bacc-12a4-45e1-9034-1e1a6cae7352 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:03.709298 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2253bacc-12a4-45e1-9034-1e1a6cae7352 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:03.710207 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2253bacc-12a4-45e1-9034-1e1a6cae7352 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:03.710789 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-2253bacc-12a4-45e1-9034-1e1a6cae7352 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:03.791694 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-2253bacc-12a4-45e1-9034-1e1a6cae7352 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba9bc42ba834887a018ea2b50fcf862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf939187436d4978a7805ab5aa91005a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:03.799629 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-2253bacc-12a4-45e1-9034-1e1a6cae7352 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] 10.222.0.46 "GET /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4" status: 200 len: 1288 microversion: 2.1 time: 0.106760 Oct 03 15:05:03.800230 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 573/1110] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:03 2022] GET /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4 => generated 1288 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:05:04.822549 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-5b3a8c50-2e12-4c7d-b866-fc9bb4cbfc6e tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:04.823167 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-5b3a8c50-2e12-4c7d-b866-fc9bb4cbfc6e tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 41a92c14-7874-4e53-b1e6-46331b3d2ca4] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:04.830470 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5b3a8c50-2e12-4c7d-b866-fc9bb4cbfc6e tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:04.830962 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5b3a8c50-2e12-4c7d-b866-fc9bb4cbfc6e tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:04.831891 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5b3a8c50-2e12-4c7d-b866-fc9bb4cbfc6e tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:04.832589 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5b3a8c50-2e12-4c7d-b866-fc9bb4cbfc6e tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:04.833050 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5b3a8c50-2e12-4c7d-b866-fc9bb4cbfc6e tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:04.833478 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5b3a8c50-2e12-4c7d-b866-fc9bb4cbfc6e tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:04.963832 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-5b3a8c50-2e12-4c7d-b866-fc9bb4cbfc6e tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba9bc42ba834887a018ea2b50fcf862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf939187436d4978a7805ab5aa91005a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:04.966026 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-5fe0de6a-e403-434e-af42-89157aef4e20 req-97b65262-f7dd-4108-9d78-7bb78011150b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41a92c14-7874-4e53-b1e6-46331b3d2ca4", "tag": "d19a1bee-251d-4ddc-85cc-0bf319cf566c"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:05:04.977333 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-5fe0de6a-e403-434e-af42-89157aef4e20 req-97b65262-f7dd-4108-9d78-7bb78011150b service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:04.977907 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-5fe0de6a-e403-434e-af42-89157aef4e20 req-97b65262-f7dd-4108-9d78-7bb78011150b service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:04.978343 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-5fe0de6a-e403-434e-af42-89157aef4e20 req-97b65262-f7dd-4108-9d78-7bb78011150b service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:04.981214 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-5b3a8c50-2e12-4c7d-b866-fc9bb4cbfc6e tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] 10.222.0.46 "GET /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4" status: 200 len: 1318 microversion: 2.1 time: 0.162504 Oct 03 15:05:04.982945 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 538/1111] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:04 2022] GET /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:05:04.990032 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-5fe0de6a-e403-434e-af42-89157aef4e20 req-97b65262-f7dd-4108-9d78-7bb78011150b service nova] Creating event network-changed:d19a1bee-251d-4ddc-85cc-0bf319cf566c for instance 41a92c14-7874-4e53-b1e6-46331b3d2ca4 on hv-cinder-85987 Oct 03 15:05:04.995778 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-5fe0de6a-e403-434e-af42-89157aef4e20 req-97b65262-f7dd-4108-9d78-7bb78011150b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034316 Oct 03 15:05:04.996875 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 574/1112] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 15:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:05:06.003816 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-6d4f6562-60b2-494d-a75c-9444837c4447 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:06.004434 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-6d4f6562-60b2-494d-a75c-9444837c4447 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 41a92c14-7874-4e53-b1e6-46331b3d2ca4] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:06.010813 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6d4f6562-60b2-494d-a75c-9444837c4447 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:06.011306 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6d4f6562-60b2-494d-a75c-9444837c4447 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:06.011748 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6d4f6562-60b2-494d-a75c-9444837c4447 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:06.012444 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6d4f6562-60b2-494d-a75c-9444837c4447 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:06.012907 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6d4f6562-60b2-494d-a75c-9444837c4447 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:06.013340 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-6d4f6562-60b2-494d-a75c-9444837c4447 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:06.140078 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-6d4f6562-60b2-494d-a75c-9444837c4447 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba9bc42ba834887a018ea2b50fcf862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf939187436d4978a7805ab5aa91005a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:06.147531 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-6d4f6562-60b2-494d-a75c-9444837c4447 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] 10.222.0.46 "GET /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4" status: 200 len: 1318 microversion: 2.1 time: 0.147569 Oct 03 15:05:06.148099 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 539/1113] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:05 2022] GET /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:05:07.172715 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-053172bf-0bc0-46b5-bf2b-79a69fab08a9 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:07.173400 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-053172bf-0bc0-46b5-bf2b-79a69fab08a9 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 41a92c14-7874-4e53-b1e6-46331b3d2ca4] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:07.179944 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-053172bf-0bc0-46b5-bf2b-79a69fab08a9 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:07.180419 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-053172bf-0bc0-46b5-bf2b-79a69fab08a9 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:07.180852 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-053172bf-0bc0-46b5-bf2b-79a69fab08a9 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:07.181554 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-053172bf-0bc0-46b5-bf2b-79a69fab08a9 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:07.182009 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-053172bf-0bc0-46b5-bf2b-79a69fab08a9 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:07.182431 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-053172bf-0bc0-46b5-bf2b-79a69fab08a9 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:07.308498 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-053172bf-0bc0-46b5-bf2b-79a69fab08a9 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba9bc42ba834887a018ea2b50fcf862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf939187436d4978a7805ab5aa91005a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:07.316727 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-053172bf-0bc0-46b5-bf2b-79a69fab08a9 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] 10.222.0.46 "GET /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4" status: 200 len: 1318 microversion: 2.1 time: 0.148703 Oct 03 15:05:07.317284 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 575/1114] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:07 2022] GET /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:05:08.338863 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-387987de-ae1c-4656-b48d-da84da5f6608 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:08.339483 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-387987de-ae1c-4656-b48d-da84da5f6608 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 41a92c14-7874-4e53-b1e6-46331b3d2ca4] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:08.345970 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-387987de-ae1c-4656-b48d-da84da5f6608 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:08.346464 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-387987de-ae1c-4656-b48d-da84da5f6608 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:08.346927 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-387987de-ae1c-4656-b48d-da84da5f6608 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:08.347626 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-387987de-ae1c-4656-b48d-da84da5f6608 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:08.348088 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-387987de-ae1c-4656-b48d-da84da5f6608 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:08.348517 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-387987de-ae1c-4656-b48d-da84da5f6608 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:08.476492 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-387987de-ae1c-4656-b48d-da84da5f6608 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba9bc42ba834887a018ea2b50fcf862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf939187436d4978a7805ab5aa91005a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:08.484088 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-387987de-ae1c-4656-b48d-da84da5f6608 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] 10.222.0.46 "GET /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4" status: 200 len: 1318 microversion: 2.1 time: 0.149390 Oct 03 15:05:08.484661 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 540/1115] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:08 2022] GET /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:05:09.506285 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-0f200e8a-6a66-4911-9521-16562783cb99 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:09.506897 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-0f200e8a-6a66-4911-9521-16562783cb99 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 41a92c14-7874-4e53-b1e6-46331b3d2ca4] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:09.513181 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0f200e8a-6a66-4911-9521-16562783cb99 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:09.513701 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0f200e8a-6a66-4911-9521-16562783cb99 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:09.514136 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0f200e8a-6a66-4911-9521-16562783cb99 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:09.514823 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0f200e8a-6a66-4911-9521-16562783cb99 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:09.515278 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0f200e8a-6a66-4911-9521-16562783cb99 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:09.515702 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-0f200e8a-6a66-4911-9521-16562783cb99 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:09.643149 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-0f200e8a-6a66-4911-9521-16562783cb99 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba9bc42ba834887a018ea2b50fcf862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf939187436d4978a7805ab5aa91005a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:09.651324 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-0f200e8a-6a66-4911-9521-16562783cb99 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] 10.222.0.46 "GET /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4" status: 200 len: 1318 microversion: 2.1 time: 0.148926 Oct 03 15:05:09.651885 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 576/1116] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:09 2022] GET /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:05:10.672719 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-034b9774-ed14-44fc-9c9f-14ed3db0b6e4 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:10.673423 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-034b9774-ed14-44fc-9c9f-14ed3db0b6e4 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 41a92c14-7874-4e53-b1e6-46331b3d2ca4] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:10.680642 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-034b9774-ed14-44fc-9c9f-14ed3db0b6e4 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:10.681136 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-034b9774-ed14-44fc-9c9f-14ed3db0b6e4 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:10.681606 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-034b9774-ed14-44fc-9c9f-14ed3db0b6e4 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:10.682301 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-034b9774-ed14-44fc-9c9f-14ed3db0b6e4 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:10.682760 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-034b9774-ed14-44fc-9c9f-14ed3db0b6e4 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:10.683191 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-034b9774-ed14-44fc-9c9f-14ed3db0b6e4 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:10.812253 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-034b9774-ed14-44fc-9c9f-14ed3db0b6e4 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba9bc42ba834887a018ea2b50fcf862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf939187436d4978a7805ab5aa91005a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:10.819870 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-034b9774-ed14-44fc-9c9f-14ed3db0b6e4 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] 10.222.0.46 "GET /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4" status: 200 len: 1318 microversion: 2.1 time: 0.151047 Oct 03 15:05:10.820443 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 541/1117] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:10 2022] GET /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:05:11.843688 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-bf817fe6-1917-4a7b-b947-3a78010639e2 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:11.844322 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-bf817fe6-1917-4a7b-b947-3a78010639e2 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 41a92c14-7874-4e53-b1e6-46331b3d2ca4] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:11.850820 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bf817fe6-1917-4a7b-b947-3a78010639e2 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:11.851309 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bf817fe6-1917-4a7b-b947-3a78010639e2 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:11.851751 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bf817fe6-1917-4a7b-b947-3a78010639e2 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:11.852446 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bf817fe6-1917-4a7b-b947-3a78010639e2 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:11.852908 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bf817fe6-1917-4a7b-b947-3a78010639e2 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:11.853332 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bf817fe6-1917-4a7b-b947-3a78010639e2 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:11.980974 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-bf817fe6-1917-4a7b-b947-3a78010639e2 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba9bc42ba834887a018ea2b50fcf862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf939187436d4978a7805ab5aa91005a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:11.989343 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-bf817fe6-1917-4a7b-b947-3a78010639e2 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] 10.222.0.46 "GET /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4" status: 200 len: 1318 microversion: 2.1 time: 0.149690 Oct 03 15:05:11.989940 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 577/1118] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:11 2022] GET /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:05:12.547047 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-19657382-6c0c-4b6d-9ccb-dc9ca09cb618 req-b6d72caf-3759-4b2d-b192-a26bbd8b6605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41a92c14-7874-4e53-b1e6-46331b3d2ca4", "name": "network-vif-plugged", "status": "completed", "tag": "d19a1bee-251d-4ddc-85cc-0bf319cf566c"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:05:12.559362 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-19657382-6c0c-4b6d-9ccb-dc9ca09cb618 req-b6d72caf-3759-4b2d-b192-a26bbd8b6605 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:12.560667 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-19657382-6c0c-4b6d-9ccb-dc9ca09cb618 req-b6d72caf-3759-4b2d-b192-a26bbd8b6605 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:12.561108 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-19657382-6c0c-4b6d-9ccb-dc9ca09cb618 req-b6d72caf-3759-4b2d-b192-a26bbd8b6605 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:12.574012 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-19657382-6c0c-4b6d-9ccb-dc9ca09cb618 req-b6d72caf-3759-4b2d-b192-a26bbd8b6605 service nova] Creating event network-vif-plugged:d19a1bee-251d-4ddc-85cc-0bf319cf566c for instance 41a92c14-7874-4e53-b1e6-46331b3d2ca4 on hv-cinder-85987 Oct 03 15:05:12.580464 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-19657382-6c0c-4b6d-9ccb-dc9ca09cb618 req-b6d72caf-3759-4b2d-b192-a26bbd8b6605 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036809 Oct 03 15:05:12.581995 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 542/1119] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 15:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:05:13.011345 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-6a390e05-30f3-475e-9a9f-d49aec85ea49 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:13.011947 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-6a390e05-30f3-475e-9a9f-d49aec85ea49 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 41a92c14-7874-4e53-b1e6-46331b3d2ca4] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:13.014198 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell0:SELECT=2 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:05:13.015239 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell0:SELECT=6 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:05:13.024426 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6a390e05-30f3-475e-9a9f-d49aec85ea49 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:13.025146 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6a390e05-30f3-475e-9a9f-d49aec85ea49 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:13.025831 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6a390e05-30f3-475e-9a9f-d49aec85ea49 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:13.026878 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6a390e05-30f3-475e-9a9f-d49aec85ea49 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:13.027580 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6a390e05-30f3-475e-9a9f-d49aec85ea49 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:13.028238 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6a390e05-30f3-475e-9a9f-d49aec85ea49 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:13.163461 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-6a390e05-30f3-475e-9a9f-d49aec85ea49 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba9bc42ba834887a018ea2b50fcf862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf939187436d4978a7805ab5aa91005a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:13.170962 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-6a390e05-30f3-475e-9a9f-d49aec85ea49 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] 10.222.0.46 "GET /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4" status: 200 len: 1318 microversion: 2.1 time: 0.163446 Oct 03 15:05:13.171526 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 578/1120] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:13 2022] GET /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:05:14.191485 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell0:SELECT=2 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:05:14.196516 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-572dd82c-1403-4d14-9b3b-fd164ee92564 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:14.197237 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-572dd82c-1403-4d14-9b3b-fd164ee92564 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 41a92c14-7874-4e53-b1e6-46331b3d2ca4] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:14.203612 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-572dd82c-1403-4d14-9b3b-fd164ee92564 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:14.204094 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-572dd82c-1403-4d14-9b3b-fd164ee92564 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:14.204550 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-572dd82c-1403-4d14-9b3b-fd164ee92564 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:14.205231 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-572dd82c-1403-4d14-9b3b-fd164ee92564 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:14.205723 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-572dd82c-1403-4d14-9b3b-fd164ee92564 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:14.206144 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-572dd82c-1403-4d14-9b3b-fd164ee92564 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:14.339946 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-572dd82c-1403-4d14-9b3b-fd164ee92564 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba9bc42ba834887a018ea2b50fcf862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf939187436d4978a7805ab5aa91005a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:14.347428 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-572dd82c-1403-4d14-9b3b-fd164ee92564 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] 10.222.0.46 "GET /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4" status: 200 len: 1318 microversion: 2.1 time: 0.157437 Oct 03 15:05:14.347988 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 543/1121] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:14 2022] GET /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:05:15.369793 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-13c716d3-a2a6-4275-a6c2-ebba50195e9b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:15.370405 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-13c716d3-a2a6-4275-a6c2-ebba50195e9b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 41a92c14-7874-4e53-b1e6-46331b3d2ca4] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:15.376781 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-13c716d3-a2a6-4275-a6c2-ebba50195e9b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:15.377257 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-13c716d3-a2a6-4275-a6c2-ebba50195e9b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:15.377727 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-13c716d3-a2a6-4275-a6c2-ebba50195e9b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:15.378448 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-13c716d3-a2a6-4275-a6c2-ebba50195e9b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:15.378900 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-13c716d3-a2a6-4275-a6c2-ebba50195e9b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:15.379322 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-13c716d3-a2a6-4275-a6c2-ebba50195e9b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:15.505202 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-13c716d3-a2a6-4275-a6c2-ebba50195e9b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba9bc42ba834887a018ea2b50fcf862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf939187436d4978a7805ab5aa91005a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:15.512813 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-13c716d3-a2a6-4275-a6c2-ebba50195e9b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] 10.222.0.46 "GET /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4" status: 200 len: 1508 microversion: 2.1 time: 0.146929 Oct 03 15:05:15.513375 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 579/1122] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:15 2022] GET /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4 => generated 1508 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:05:35.961025 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-94d10f15-190e-43c0-bff2-5430cc8494cf tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35614912-3b31-4848-b62f-1eb43691dcf3", "device": "/dev/sdb"}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:05:35.964037 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-94d10f15-190e-43c0-bff2-5430cc8494cf tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 41a92c14-7874-4e53-b1e6-46331b3d2ca4] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:35.966057 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_api:SELECT=16 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:05:35.966843 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=32 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:05:35.972807 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-94d10f15-190e-43c0-bff2-5430cc8494cf tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:35.973296 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-94d10f15-190e-43c0-bff2-5430cc8494cf tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:35.973771 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-94d10f15-190e-43c0-bff2-5430cc8494cf tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:35.974555 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-94d10f15-190e-43c0-bff2-5430cc8494cf tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:35.975019 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-94d10f15-190e-43c0-bff2-5430cc8494cf tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:35.975447 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-94d10f15-190e-43c0-bff2-5430cc8494cf tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:36.226325 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-94d10f15-190e-43c0-bff2-5430cc8494cf tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] 10.222.0.46 "POST /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270032 Oct 03 15:05:36.226941 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 544/1123] 10.222.0.46 () {60 vars in 1323 bytes} [Mon Oct 3 15:05:35 2022] POST /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:06:02.984263 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-5969d6ef-eca2-47a7-9d24-8170d8676cd1 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:02.984771 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-5969d6ef-eca2-47a7-9d24-8170d8676cd1 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 41a92c14-7874-4e53-b1e6-46331b3d2ca4] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:02.986793 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:06:02.987490 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=40 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:06:02.994507 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5969d6ef-eca2-47a7-9d24-8170d8676cd1 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:02.994994 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5969d6ef-eca2-47a7-9d24-8170d8676cd1 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:02.995430 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5969d6ef-eca2-47a7-9d24-8170d8676cd1 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:02.996124 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5969d6ef-eca2-47a7-9d24-8170d8676cd1 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:02.996581 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5969d6ef-eca2-47a7-9d24-8170d8676cd1 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:02.997004 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5969d6ef-eca2-47a7-9d24-8170d8676cd1 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:03.077297 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.objects.instance [None req-5969d6ef-eca2-47a7-9d24-8170d8676cd1 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lazy-loading 'services' on Instance uuid 41a92c14-7874-4e53-b1e6-46331b3d2ca4 {{(pid=126851) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:06:03.147346 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-5969d6ef-eca2-47a7-9d24-8170d8676cd1 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] 10.222.0.46 "DELETE /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4/os-volume_attachments/35614912-3b31-4848-b62f-1eb43691dcf3" status: 202 len: 0 microversion: 2.1 time: 0.166930 Oct 03 15:06:03.147918 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 580/1124] 10.222.0.46 () {58 vars in 1416 bytes} [Mon Oct 3 15:06:02 2022] DELETE /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4/os-volume_attachments/35614912-3b31-4848-b62f-1eb43691dcf3 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:06:04.269803 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-8efe5ea0-77c8-4698-84c5-c23b3421708a tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:04.270390 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-8efe5ea0-77c8-4698-84c5-c23b3421708a tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 41a92c14-7874-4e53-b1e6-46331b3d2ca4] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:04.273768 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 15:06:04.273908 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Mon Oct 3 15:06:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4 (ip 10.222.0.46) !!! Oct 03 15:06:04.275210 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_api:SELECT=2 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:06:04.275886 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:06:04.284362 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8efe5ea0-77c8-4698-84c5-c23b3421708a tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:04.284848 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8efe5ea0-77c8-4698-84c5-c23b3421708a tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:04.285282 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8efe5ea0-77c8-4698-84c5-c23b3421708a tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:04.286016 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8efe5ea0-77c8-4698-84c5-c23b3421708a tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:04.286473 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8efe5ea0-77c8-4698-84c5-c23b3421708a tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:04.286899 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8efe5ea0-77c8-4698-84c5-c23b3421708a tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:04.312944 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-8efe5ea0-77c8-4698-84c5-c23b3421708a tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 41a92c14-7874-4e53-b1e6-46331b3d2ca4] Going to try to terminate instance {{(pid=126852) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:06:04.386719 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-8efe5ea0-77c8-4698-84c5-c23b3421708a tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] 10.222.0.46 "DELETE /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4" status: 204 len: 0 microversion: 2.1 time: 0.120837 Oct 03 15:06:04.387497 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 545/1125] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 3 15:06:04 2022] DELETE /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:06:04.397172 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-274d1be3-2cce-4648-9be4-c0c295c1f8da tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:04.397895 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-274d1be3-2cce-4648-9be4-c0c295c1f8da tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 41a92c14-7874-4e53-b1e6-46331b3d2ca4] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:04.403989 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-274d1be3-2cce-4648-9be4-c0c295c1f8da tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:04.404471 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-274d1be3-2cce-4648-9be4-c0c295c1f8da tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:04.404909 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-274d1be3-2cce-4648-9be4-c0c295c1f8da tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:04.405652 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-274d1be3-2cce-4648-9be4-c0c295c1f8da tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:04.406096 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-274d1be3-2cce-4648-9be4-c0c295c1f8da tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:04.406520 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-274d1be3-2cce-4648-9be4-c0c295c1f8da tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:04.537656 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-274d1be3-2cce-4648-9be4-c0c295c1f8da tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba9bc42ba834887a018ea2b50fcf862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf939187436d4978a7805ab5aa91005a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:06:04.545343 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-274d1be3-2cce-4648-9be4-c0c295c1f8da tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] 10.222.0.46 "GET /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4" status: 200 len: 1514 microversion: 2.1 time: 0.153547 Oct 03 15:06:04.545943 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 581/1126] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:04 2022] GET /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:05.568802 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-c23d345a-55de-4e18-b409-53df5f0c133b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:05.569419 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-c23d345a-55de-4e18-b409-53df5f0c133b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 41a92c14-7874-4e53-b1e6-46331b3d2ca4] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:05.575759 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c23d345a-55de-4e18-b409-53df5f0c133b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:05.576237 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c23d345a-55de-4e18-b409-53df5f0c133b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:05.576670 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c23d345a-55de-4e18-b409-53df5f0c133b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:05.577354 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c23d345a-55de-4e18-b409-53df5f0c133b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:05.577834 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c23d345a-55de-4e18-b409-53df5f0c133b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:05.578260 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-c23d345a-55de-4e18-b409-53df5f0c133b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:05.706933 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-c23d345a-55de-4e18-b409-53df5f0c133b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba9bc42ba834887a018ea2b50fcf862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf939187436d4978a7805ab5aa91005a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:06:05.715514 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-c23d345a-55de-4e18-b409-53df5f0c133b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] 10.222.0.46 "GET /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4" status: 200 len: 1514 microversion: 2.1 time: 0.151091 Oct 03 15:06:05.716084 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 546/1127] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:05 2022] GET /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:06.738350 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-6e8cc262-68b8-4084-ae5f-3bcf0e3fcf2b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:06.738959 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-6e8cc262-68b8-4084-ae5f-3bcf0e3fcf2b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 41a92c14-7874-4e53-b1e6-46331b3d2ca4] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:06.745919 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6e8cc262-68b8-4084-ae5f-3bcf0e3fcf2b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:06.746399 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6e8cc262-68b8-4084-ae5f-3bcf0e3fcf2b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:06.746855 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6e8cc262-68b8-4084-ae5f-3bcf0e3fcf2b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:06.747540 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6e8cc262-68b8-4084-ae5f-3bcf0e3fcf2b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:06.747990 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6e8cc262-68b8-4084-ae5f-3bcf0e3fcf2b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:06.748410 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6e8cc262-68b8-4084-ae5f-3bcf0e3fcf2b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:06.931124 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-6e8cc262-68b8-4084-ae5f-3bcf0e3fcf2b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba9bc42ba834887a018ea2b50fcf862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf939187436d4978a7805ab5aa91005a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:06:06.938705 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-6e8cc262-68b8-4084-ae5f-3bcf0e3fcf2b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] 10.222.0.46 "GET /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4" status: 200 len: 1514 microversion: 2.1 time: 0.204197 Oct 03 15:06:06.939270 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 582/1128] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:06 2022] GET /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4 => generated 1514 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:07.142736 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-604351de-ced4-4a0b-8aa2-ba4745f2490f req-1d898634-58ba-4c2d-a225-fd2a9bf6a14e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41a92c14-7874-4e53-b1e6-46331b3d2ca4", "name": "network-vif-deleted", "tag": "d19a1bee-251d-4ddc-85cc-0bf319cf566c"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:06:07.154898 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-604351de-ced4-4a0b-8aa2-ba4745f2490f req-1d898634-58ba-4c2d-a225-fd2a9bf6a14e service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:07.155371 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-604351de-ced4-4a0b-8aa2-ba4745f2490f req-1d898634-58ba-4c2d-a225-fd2a9bf6a14e service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:07.155794 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-604351de-ced4-4a0b-8aa2-ba4745f2490f req-1d898634-58ba-4c2d-a225-fd2a9bf6a14e service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:07.169301 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-604351de-ced4-4a0b-8aa2-ba4745f2490f req-1d898634-58ba-4c2d-a225-fd2a9bf6a14e service nova] Creating event network-vif-deleted:d19a1bee-251d-4ddc-85cc-0bf319cf566c for instance 41a92c14-7874-4e53-b1e6-46331b3d2ca4 on hv-cinder-85987 Oct 03 15:06:07.175370 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-604351de-ced4-4a0b-8aa2-ba4745f2490f req-1d898634-58ba-4c2d-a225-fd2a9bf6a14e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036340 Oct 03 15:06:07.175966 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 547/1129] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 15:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:06:07.960877 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-ec7242b9-46f6-4033-8d6b-c68e5895417e tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:07.961801 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-ec7242b9-46f6-4033-8d6b-c68e5895417e tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 41a92c14-7874-4e53-b1e6-46331b3d2ca4] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:07.968120 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ec7242b9-46f6-4033-8d6b-c68e5895417e tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:07.968605 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ec7242b9-46f6-4033-8d6b-c68e5895417e tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:07.969042 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ec7242b9-46f6-4033-8d6b-c68e5895417e tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:07.969798 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ec7242b9-46f6-4033-8d6b-c68e5895417e tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:07.970250 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ec7242b9-46f6-4033-8d6b-c68e5895417e tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:07.970675 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-ec7242b9-46f6-4033-8d6b-c68e5895417e tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:07.983623 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.wsgi [None req-ec7242b9-46f6-4033-8d6b-c68e5895417e tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] HTTP exception thrown: Instance 41a92c14-7874-4e53-b1e6-46331b3d2ca4 could not be found. Oct 03 15:06:07.985226 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-ec7242b9-46f6-4033-8d6b-c68e5895417e tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Request method failure captured: Oct 03 15:06:07.985226 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: request: GET /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4 HTTP/1.1 Oct 03 15:06:07.985226 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept: application/json Oct 03 15:06:07.985226 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept-Encoding: identity Oct 03 15:06:07.985226 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Connection: close Oct 03 15:06:07.985226 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Length: 0 Oct 03 15:06:07.985226 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Type: application/json Oct 03 15:06:07.985226 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Host: 10.222.0.46 Oct 03 15:06:07.985226 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Openstack-System-Scope: None Oct 03 15:06:07.985226 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: User-Agent: python-urllib3/1.26.12 Oct 03 15:06:07.985226 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Auth-Token: gAAAAABjOvoczFjF1fHhVIJj9yEQNi616VmdOQMLUIhD53nE2fT2zG7Hy3zBTQHkw4NUjyb-H-sM6U77eNYEpWQBYyuFW7RasYl42JrTkAwmP-DR0mrtvF1KrMXOfoJGK05VmhDacBYulYvdld2SHApCZ_raGkNpSjVqqV87HbcBPt2weW-3UvM Oct 03 15:06:07.985226 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Id: None Oct 03 15:06:07.985226 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Name: None Oct 03 15:06:07.985226 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Identity-Status: Confirmed Oct 03 15:06:07.985226 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Is-Admin-Project: True Oct 03 15:06:07.985226 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Id: default Oct 03 15:06:07.985226 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Name: Default Oct 03 15:06:07.985226 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Id: cf939187436d4978a7805ab5aa91005a Oct 03 15:06:07.985226 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Name: tempest-VolumesSnapshotTestJSON-56307656 Oct 03 15:06:07.985226 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Role: member,reader Oct 03 15:06:07.985226 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Roles: member,reader Oct 03 15:06:07.986928 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cf939187436d4978a7805ab5aa91005a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_cf939187436d4978a7805ab5aa91005a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cf939187436d4978a7805ab5aa91005a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/cf939187436d4978a7805ab5aa91005a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 15:06:07.986928 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant: tempest-VolumesSnapshotTestJSON-56307656 Oct 03 15:06:07.986928 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Id: cf939187436d4978a7805ab5aa91005a Oct 03 15:06:07.986928 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-56307656 Oct 03 15:06:07.986928 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User: tempest-VolumesSnapshotTestJSON-56307656-project Oct 03 15:06:07.986928 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Id: default Oct 03 15:06:07.986928 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Name: Default Oct 03 15:06:07.986928 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Id: fba9bc42ba834887a018ea2b50fcf862 Oct 03 15:06:07.986928 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Name: tempest-VolumesSnapshotTestJSON-56307656-project Oct 03 15:06:07.986928 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: method: > Oct 03 15:06:07.986928 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: exception: Instance 41a92c14-7874-4e53-b1e6-46331b3d2ca4 could not be found. Oct 03 15:06:07.986928 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: action_args: {'id': '41a92c14-7874-4e53-b1e6-46331b3d2ca4'} Oct 03 15:06:07.988776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:06:07.988776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:06:07.988776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:06:07.988776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:06:07.988776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:06:07.988776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:06:07.988776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:06:07.988776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:06:07.988776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:06:07.988776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:06:07.988776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41a92c14-7874-4e53-b1e6-46331b3d2ca4 could not be found. Oct 03 15:06:07.988776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:06:07.988776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:06:07.988776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:06:07.988776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:06:07.988776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:06:07.988776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:06:07.988776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:06:07.988776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:06:07.988776 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:06:07.991031 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:06:07.991031 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:06:07.991031 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:06:07.991031 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:06:07.991031 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:06:07.991031 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:06:07.991031 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:06:07.991031 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41a92c14-7874-4e53-b1e6-46331b3d2ca4 could not be found. Oct 03 15:06:07.991031 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:06:07.991031 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:06:07.991031 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:06:07.991031 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:06:07.991031 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:06:07.991031 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:06:07.991031 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:06:07.991031 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:06:07.991031 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41a92c14-7874-4e53-b1e6-46331b3d2ca4 could not be found. Oct 03 15:06:07.991031 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:06:07.992552 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-ec7242b9-46f6-4033-8d6b-c68e5895417e tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Returning 404 to user: Instance 41a92c14-7874-4e53-b1e6-46331b3d2ca4 could not be found. {{(pid=126851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:06:07.992552 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-ec7242b9-46f6-4033-8d6b-c68e5895417e tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] 10.222.0.46 "GET /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4" status: 404 len: 111 microversion: 2.1 time: 0.029725 Oct 03 15:06:07.992552 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 583/1130] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:07 2022] GET /compute/v2.1/servers/41a92c14-7874-4e53-b1e6-46331b3d2ca4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:06:17.815911 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-66cc5972-8ad3-48c5-9690-7bdc8ab19fdb tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1215332012", "imageRef": "add7a872-2ca1-4366-9a93-f0663fdb297b", "flavorRef": "452", "networks": [{"uuid": "e829d98a-e29f-45ac-9a33-fac7c75b7c82"}]}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:06:17.825306 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:06:17.825975 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:06:17.872164 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.network.neutron [None req-66cc5972-8ad3-48c5-9690-7bdc8ab19fdb tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] validate_networks() for [('e829d98a-e29f-45ac-9a33-fac7c75b7c82', None, None, None, None, None)] {{(pid=126852) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:06:18.455703 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-66cc5972-8ad3-48c5-9690-7bdc8ab19fdb tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Flavor limits 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:06:18.456119 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-66cc5972-8ad3-48c5-9690-7bdc8ab19fdb tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Image limits 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:06:18.456612 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-66cc5972-8ad3-48c5-9690-7bdc8ab19fdb tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Flavor pref 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:06:18.457013 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-66cc5972-8ad3-48c5-9690-7bdc8ab19fdb tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Image pref 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:06:18.457414 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-66cc5972-8ad3-48c5-9690-7bdc8ab19fdb tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:06:18.466250 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-66cc5972-8ad3-48c5-9690-7bdc8ab19fdb tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:18.466726 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-66cc5972-8ad3-48c5-9690-7bdc8ab19fdb tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:18.467156 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-66cc5972-8ad3-48c5-9690-7bdc8ab19fdb tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:18.467872 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-66cc5972-8ad3-48c5-9690-7bdc8ab19fdb tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:18.468320 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-66cc5972-8ad3-48c5-9690-7bdc8ab19fdb tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:18.468740 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-66cc5972-8ad3-48c5-9690-7bdc8ab19fdb tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:18.484630 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-66cc5972-8ad3-48c5-9690-7bdc8ab19fdb tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Getting quotas for project cf939187436d4978a7805ab5aa91005a. Resources: {'ram', 'instances', 'cores'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:06:18.488518 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-66cc5972-8ad3-48c5-9690-7bdc8ab19fdb tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Getting quotas for user fba9bc42ba834887a018ea2b50fcf862 and project cf939187436d4978a7805ab5aa91005a. Resources: {'ram', 'instances', 'cores'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:06:18.499552 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-66cc5972-8ad3-48c5-9690-7bdc8ab19fdb tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Going to run 1 instances... {{(pid=126852) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:06:18.501919 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-66cc5972-8ad3-48c5-9690-7bdc8ab19fdb tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 9e1027c2-7a56-436c-9a65-ffaeac086d95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='add7a872-2ca1-4366-9a93-f0663fdb297b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:06:18.548312 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-66cc5972-8ad3-48c5-9690-7bdc8ab19fdb tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.736578 Oct 03 15:06:18.548974 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 548/1131] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 3 15:06:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:06:18.561927 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-8d07911d-be63-4f35-a1d3-a02c5bb04a9f tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:18.562537 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-8d07911d-be63-4f35-a1d3-a02c5bb04a9f tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 9e1027c2-7a56-436c-9a65-ffaeac086d95] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:18.567212 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_api:SELECT=8 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:06:18.567966 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:06:18.619991 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-8d07911d-be63-4f35-a1d3-a02c5bb04a9f tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba9bc42ba834887a018ea2b50fcf862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf939187436d4978a7805ab5aa91005a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:06:18.627242 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-8d07911d-be63-4f35-a1d3-a02c5bb04a9f tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1027c2-7a56-436c-9a65-ffaeac086d95" status: 200 len: 1219 microversion: 2.1 time: 0.070331 Oct 03 15:06:18.627816 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 584/1132] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:18 2022] GET /compute/v2.1/servers/9e1027c2-7a56-436c-9a65-ffaeac086d95 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:19.650997 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-f8ae3bf8-fe1b-438d-ab66-1d2c72895b62 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:19.651690 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-f8ae3bf8-fe1b-438d-ab66-1d2c72895b62 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 9e1027c2-7a56-436c-9a65-ffaeac086d95] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:19.658671 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f8ae3bf8-fe1b-438d-ab66-1d2c72895b62 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:19.659279 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f8ae3bf8-fe1b-438d-ab66-1d2c72895b62 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:19.659984 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f8ae3bf8-fe1b-438d-ab66-1d2c72895b62 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:19.660977 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f8ae3bf8-fe1b-438d-ab66-1d2c72895b62 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:19.661384 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f8ae3bf8-fe1b-438d-ab66-1d2c72895b62 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:19.661933 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f8ae3bf8-fe1b-438d-ab66-1d2c72895b62 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:19.731634 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-f8ae3bf8-fe1b-438d-ab66-1d2c72895b62 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba9bc42ba834887a018ea2b50fcf862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf939187436d4978a7805ab5aa91005a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:06:19.739205 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-f8ae3bf8-fe1b-438d-ab66-1d2c72895b62 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1027c2-7a56-436c-9a65-ffaeac086d95" status: 200 len: 1277 microversion: 2.1 time: 0.093140 Oct 03 15:06:19.740305 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 549/1133] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:19 2022] GET /compute/v2.1/servers/9e1027c2-7a56-436c-9a65-ffaeac086d95 => generated 1277 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:20.763091 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-7f932ea0-0625-4e97-8252-dee13f557cf9 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:20.763817 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-7f932ea0-0625-4e97-8252-dee13f557cf9 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 9e1027c2-7a56-436c-9a65-ffaeac086d95] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:20.771151 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7f932ea0-0625-4e97-8252-dee13f557cf9 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:20.771722 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7f932ea0-0625-4e97-8252-dee13f557cf9 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:20.772165 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7f932ea0-0625-4e97-8252-dee13f557cf9 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:20.772848 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7f932ea0-0625-4e97-8252-dee13f557cf9 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:20.773298 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7f932ea0-0625-4e97-8252-dee13f557cf9 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:20.773743 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-7f932ea0-0625-4e97-8252-dee13f557cf9 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:21.002456 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-7f932ea0-0625-4e97-8252-dee13f557cf9 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba9bc42ba834887a018ea2b50fcf862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf939187436d4978a7805ab5aa91005a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:06:21.009900 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-7f932ea0-0625-4e97-8252-dee13f557cf9 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1027c2-7a56-436c-9a65-ffaeac086d95" status: 200 len: 1319 microversion: 2.1 time: 0.250647 Oct 03 15:06:21.010459 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 585/1134] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:20 2022] GET /compute/v2.1/servers/9e1027c2-7a56-436c-9a65-ffaeac086d95 => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:21.187030 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-9355b0cb-e82e-41b0-8d53-6fd86b72385b req-95220bd5-81d5-417c-a81d-6357844c119b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e1027c2-7a56-436c-9a65-ffaeac086d95", "tag": "dbf28f4a-4055-44ed-9109-da33f7625589"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:06:21.198226 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-9355b0cb-e82e-41b0-8d53-6fd86b72385b req-95220bd5-81d5-417c-a81d-6357844c119b service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:21.198888 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-9355b0cb-e82e-41b0-8d53-6fd86b72385b req-95220bd5-81d5-417c-a81d-6357844c119b service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:21.199435 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-9355b0cb-e82e-41b0-8d53-6fd86b72385b req-95220bd5-81d5-417c-a81d-6357844c119b service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:21.211389 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-9355b0cb-e82e-41b0-8d53-6fd86b72385b req-95220bd5-81d5-417c-a81d-6357844c119b service nova] Creating event network-changed:dbf28f4a-4055-44ed-9109-da33f7625589 for instance 9e1027c2-7a56-436c-9a65-ffaeac086d95 on hv-cinder-85987 Oct 03 15:06:21.216836 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-9355b0cb-e82e-41b0-8d53-6fd86b72385b req-95220bd5-81d5-417c-a81d-6357844c119b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033766 Oct 03 15:06:21.217469 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 550/1135] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 15:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:06:22.032840 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-1b8245de-0945-4a11-99a8-b9eacd1c9711 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:22.033451 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-1b8245de-0945-4a11-99a8-b9eacd1c9711 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 9e1027c2-7a56-436c-9a65-ffaeac086d95] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:22.039991 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1b8245de-0945-4a11-99a8-b9eacd1c9711 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:22.040469 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1b8245de-0945-4a11-99a8-b9eacd1c9711 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:22.040900 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1b8245de-0945-4a11-99a8-b9eacd1c9711 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:22.041632 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1b8245de-0945-4a11-99a8-b9eacd1c9711 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:22.042089 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1b8245de-0945-4a11-99a8-b9eacd1c9711 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:22.042540 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1b8245de-0945-4a11-99a8-b9eacd1c9711 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:22.168679 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-1b8245de-0945-4a11-99a8-b9eacd1c9711 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba9bc42ba834887a018ea2b50fcf862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf939187436d4978a7805ab5aa91005a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:06:22.176228 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-1b8245de-0945-4a11-99a8-b9eacd1c9711 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1027c2-7a56-436c-9a65-ffaeac086d95" status: 200 len: 1319 microversion: 2.1 time: 0.147285 Oct 03 15:06:22.176784 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 586/1136] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:22 2022] GET /compute/v2.1/servers/9e1027c2-7a56-436c-9a65-ffaeac086d95 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:23.200522 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-0079e4a8-d6d5-4f16-90f4-5d43cf886c4f tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:23.201218 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-0079e4a8-d6d5-4f16-90f4-5d43cf886c4f tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 9e1027c2-7a56-436c-9a65-ffaeac086d95] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:23.207382 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0079e4a8-d6d5-4f16-90f4-5d43cf886c4f tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:23.207873 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0079e4a8-d6d5-4f16-90f4-5d43cf886c4f tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:23.208932 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0079e4a8-d6d5-4f16-90f4-5d43cf886c4f tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:23.209657 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0079e4a8-d6d5-4f16-90f4-5d43cf886c4f tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:23.210115 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0079e4a8-d6d5-4f16-90f4-5d43cf886c4f tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:23.210543 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-0079e4a8-d6d5-4f16-90f4-5d43cf886c4f tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:23.338283 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-0079e4a8-d6d5-4f16-90f4-5d43cf886c4f tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba9bc42ba834887a018ea2b50fcf862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf939187436d4978a7805ab5aa91005a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:06:23.345805 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-0079e4a8-d6d5-4f16-90f4-5d43cf886c4f tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1027c2-7a56-436c-9a65-ffaeac086d95" status: 200 len: 1319 microversion: 2.1 time: 0.149868 Oct 03 15:06:23.346375 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 551/1137] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:23 2022] GET /compute/v2.1/servers/9e1027c2-7a56-436c-9a65-ffaeac086d95 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:24.368101 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-a9a22ea6-242b-4dfd-b338-a1b897fa4c92 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:24.368711 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-a9a22ea6-242b-4dfd-b338-a1b897fa4c92 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 9e1027c2-7a56-436c-9a65-ffaeac086d95] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:24.375164 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a9a22ea6-242b-4dfd-b338-a1b897fa4c92 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:24.375587 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a9a22ea6-242b-4dfd-b338-a1b897fa4c92 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:24.376026 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a9a22ea6-242b-4dfd-b338-a1b897fa4c92 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:24.376714 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a9a22ea6-242b-4dfd-b338-a1b897fa4c92 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:24.377169 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a9a22ea6-242b-4dfd-b338-a1b897fa4c92 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:24.377621 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a9a22ea6-242b-4dfd-b338-a1b897fa4c92 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:24.506797 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-a9a22ea6-242b-4dfd-b338-a1b897fa4c92 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba9bc42ba834887a018ea2b50fcf862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf939187436d4978a7805ab5aa91005a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:06:24.514437 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-a9a22ea6-242b-4dfd-b338-a1b897fa4c92 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1027c2-7a56-436c-9a65-ffaeac086d95" status: 200 len: 1319 microversion: 2.1 time: 0.150202 Oct 03 15:06:24.515004 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 587/1138] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:24 2022] GET /compute/v2.1/servers/9e1027c2-7a56-436c-9a65-ffaeac086d95 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:25.537586 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-2c2ef1e6-4a12-4ecd-9685-10bf7f930ec3 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:25.538128 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-2c2ef1e6-4a12-4ecd-9685-10bf7f930ec3 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 9e1027c2-7a56-436c-9a65-ffaeac086d95] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:25.544445 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2c2ef1e6-4a12-4ecd-9685-10bf7f930ec3 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:25.544933 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2c2ef1e6-4a12-4ecd-9685-10bf7f930ec3 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:25.545367 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2c2ef1e6-4a12-4ecd-9685-10bf7f930ec3 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:25.546092 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2c2ef1e6-4a12-4ecd-9685-10bf7f930ec3 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:25.546550 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2c2ef1e6-4a12-4ecd-9685-10bf7f930ec3 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:25.546976 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-2c2ef1e6-4a12-4ecd-9685-10bf7f930ec3 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:25.677120 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-2c2ef1e6-4a12-4ecd-9685-10bf7f930ec3 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba9bc42ba834887a018ea2b50fcf862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf939187436d4978a7805ab5aa91005a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:06:25.684733 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-2c2ef1e6-4a12-4ecd-9685-10bf7f930ec3 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1027c2-7a56-436c-9a65-ffaeac086d95" status: 200 len: 1319 microversion: 2.1 time: 0.151644 Oct 03 15:06:25.685304 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 552/1139] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:25 2022] GET /compute/v2.1/servers/9e1027c2-7a56-436c-9a65-ffaeac086d95 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:26.707307 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-15cc0771-d923-4352-85f6-04881b16e4ee tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:26.707915 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-15cc0771-d923-4352-85f6-04881b16e4ee tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 9e1027c2-7a56-436c-9a65-ffaeac086d95] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:26.714435 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-15cc0771-d923-4352-85f6-04881b16e4ee tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:26.714912 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-15cc0771-d923-4352-85f6-04881b16e4ee tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:26.715341 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-15cc0771-d923-4352-85f6-04881b16e4ee tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:26.716025 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-15cc0771-d923-4352-85f6-04881b16e4ee tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:26.716474 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-15cc0771-d923-4352-85f6-04881b16e4ee tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:26.716892 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-15cc0771-d923-4352-85f6-04881b16e4ee tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:26.759650 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-89ff58c7-3780-4af6-a379-36db44b51dc6 req-1c09bfa3-1ad2-48f3-aa85-6c5d9b05163c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e1027c2-7a56-436c-9a65-ffaeac086d95", "name": "network-vif-plugged", "status": "completed", "tag": "dbf28f4a-4055-44ed-9109-da33f7625589"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:06:26.770190 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-89ff58c7-3780-4af6-a379-36db44b51dc6 req-1c09bfa3-1ad2-48f3-aa85-6c5d9b05163c service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:26.770889 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-89ff58c7-3780-4af6-a379-36db44b51dc6 req-1c09bfa3-1ad2-48f3-aa85-6c5d9b05163c service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:26.771409 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-89ff58c7-3780-4af6-a379-36db44b51dc6 req-1c09bfa3-1ad2-48f3-aa85-6c5d9b05163c service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:26.782877 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-89ff58c7-3780-4af6-a379-36db44b51dc6 req-1c09bfa3-1ad2-48f3-aa85-6c5d9b05163c service nova] Creating event network-vif-plugged:dbf28f4a-4055-44ed-9109-da33f7625589 for instance 9e1027c2-7a56-436c-9a65-ffaeac086d95 on hv-cinder-85987 Oct 03 15:06:26.788327 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-89ff58c7-3780-4af6-a379-36db44b51dc6 req-1c09bfa3-1ad2-48f3-aa85-6c5d9b05163c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033068 Oct 03 15:06:26.788929 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 553/1140] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 15:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:06:26.857046 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-15cc0771-d923-4352-85f6-04881b16e4ee tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba9bc42ba834887a018ea2b50fcf862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf939187436d4978a7805ab5aa91005a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:06:26.865425 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-15cc0771-d923-4352-85f6-04881b16e4ee tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1027c2-7a56-436c-9a65-ffaeac086d95" status: 200 len: 1319 microversion: 2.1 time: 0.161982 Oct 03 15:06:26.866013 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 588/1141] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:26 2022] GET /compute/v2.1/servers/9e1027c2-7a56-436c-9a65-ffaeac086d95 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:27.889009 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-9e8b92eb-0667-486d-a25c-171797b35619 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:27.889727 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-9e8b92eb-0667-486d-a25c-171797b35619 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 9e1027c2-7a56-436c-9a65-ffaeac086d95] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:27.896383 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9e8b92eb-0667-486d-a25c-171797b35619 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:27.896860 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9e8b92eb-0667-486d-a25c-171797b35619 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:27.897297 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9e8b92eb-0667-486d-a25c-171797b35619 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:27.898007 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9e8b92eb-0667-486d-a25c-171797b35619 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:27.898456 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9e8b92eb-0667-486d-a25c-171797b35619 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:27.898876 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-9e8b92eb-0667-486d-a25c-171797b35619 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:28.028820 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-9e8b92eb-0667-486d-a25c-171797b35619 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba9bc42ba834887a018ea2b50fcf862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf939187436d4978a7805ab5aa91005a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:06:28.036448 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-9e8b92eb-0667-486d-a25c-171797b35619 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1027c2-7a56-436c-9a65-ffaeac086d95" status: 200 len: 1319 microversion: 2.1 time: 0.152110 Oct 03 15:06:28.037012 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 554/1142] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:27 2022] GET /compute/v2.1/servers/9e1027c2-7a56-436c-9a65-ffaeac086d95 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:29.059496 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-88c78732-a42c-4a9d-984e-f43c653b58c2 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:29.060045 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-88c78732-a42c-4a9d-984e-f43c653b58c2 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 9e1027c2-7a56-436c-9a65-ffaeac086d95] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:29.062348 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell0:SELECT=2 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:06:29.067773 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-88c78732-a42c-4a9d-984e-f43c653b58c2 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:29.068251 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-88c78732-a42c-4a9d-984e-f43c653b58c2 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:29.068682 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-88c78732-a42c-4a9d-984e-f43c653b58c2 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:29.069371 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-88c78732-a42c-4a9d-984e-f43c653b58c2 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:29.069845 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-88c78732-a42c-4a9d-984e-f43c653b58c2 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:29.070266 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-88c78732-a42c-4a9d-984e-f43c653b58c2 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:29.198569 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-88c78732-a42c-4a9d-984e-f43c653b58c2 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba9bc42ba834887a018ea2b50fcf862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf939187436d4978a7805ab5aa91005a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:06:29.206369 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-88c78732-a42c-4a9d-984e-f43c653b58c2 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1027c2-7a56-436c-9a65-ffaeac086d95" status: 200 len: 1509 microversion: 2.1 time: 0.150873 Oct 03 15:06:29.207125 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 589/1143] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:29 2022] GET /compute/v2.1/servers/9e1027c2-7a56-436c-9a65-ffaeac086d95 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:29.229436 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-82f6f431-e805-4228-b6de-33491206d2f7 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d47c828c-11d6-4b10-963c-579456190c61", "device": "/dev/sdb"}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:06:29.231859 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-82f6f431-e805-4228-b6de-33491206d2f7 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 9e1027c2-7a56-436c-9a65-ffaeac086d95] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:29.233804 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell0:SELECT=2 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:06:29.234454 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell0:SELECT=6 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:06:29.240908 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-82f6f431-e805-4228-b6de-33491206d2f7 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:29.241387 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-82f6f431-e805-4228-b6de-33491206d2f7 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:29.241844 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-82f6f431-e805-4228-b6de-33491206d2f7 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:29.242555 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-82f6f431-e805-4228-b6de-33491206d2f7 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:29.243005 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-82f6f431-e805-4228-b6de-33491206d2f7 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:29.243421 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-82f6f431-e805-4228-b6de-33491206d2f7 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:29.494569 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-82f6f431-e805-4228-b6de-33491206d2f7 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] 10.222.0.46 "POST /compute/v2.1/servers/9e1027c2-7a56-436c-9a65-ffaeac086d95/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268906 Oct 03 15:06:29.495282 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 555/1144] 10.222.0.46 () {60 vars in 1323 bytes} [Mon Oct 3 15:06:29 2022] POST /compute/v2.1/servers/9e1027c2-7a56-436c-9a65-ffaeac086d95/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:06:51.915674 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-bbf1b03b-6cc9-41f2-9897-fd5a36220904 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:51.916204 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-bbf1b03b-6cc9-41f2-9897-fd5a36220904 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 9e1027c2-7a56-436c-9a65-ffaeac086d95] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:51.918267 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_api:SELECT=14 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:06:51.918952 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=30 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:06:51.919761 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 15:06:51.920047 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Mon Oct 3 15:06:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9e1027c2-7a56-436c-9a65-ffaeac086d95/os-volume_attachments/d47c828c-11d6-4b10-963c-579456190c61 (ip 10.222.0.46) !!! Oct 03 15:06:51.926968 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bbf1b03b-6cc9-41f2-9897-fd5a36220904 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:51.927443 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bbf1b03b-6cc9-41f2-9897-fd5a36220904 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:51.927872 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bbf1b03b-6cc9-41f2-9897-fd5a36220904 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:51.928629 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bbf1b03b-6cc9-41f2-9897-fd5a36220904 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:51.929080 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bbf1b03b-6cc9-41f2-9897-fd5a36220904 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:51.929521 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-bbf1b03b-6cc9-41f2-9897-fd5a36220904 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:52.008698 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.objects.instance [None req-bbf1b03b-6cc9-41f2-9897-fd5a36220904 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lazy-loading 'services' on Instance uuid 9e1027c2-7a56-436c-9a65-ffaeac086d95 {{(pid=126851) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:06:52.079781 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-bbf1b03b-6cc9-41f2-9897-fd5a36220904 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9e1027c2-7a56-436c-9a65-ffaeac086d95/os-volume_attachments/d47c828c-11d6-4b10-963c-579456190c61" status: 202 len: 0 microversion: 2.1 time: 0.168561 Oct 03 15:06:52.080433 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 590/1145] 10.222.0.46 () {58 vars in 1416 bytes} [Mon Oct 3 15:06:51 2022] DELETE /compute/v2.1/servers/9e1027c2-7a56-436c-9a65-ffaeac086d95/os-volume_attachments/d47c828c-11d6-4b10-963c-579456190c61 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:06:53.199789 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:06:53.200683 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:06:53.204647 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-32a1972e-481f-43fb-9b70-f05b54151768 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:53.205262 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-32a1972e-481f-43fb-9b70-f05b54151768 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 9e1027c2-7a56-436c-9a65-ffaeac086d95] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:53.212862 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-32a1972e-481f-43fb-9b70-f05b54151768 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:53.213341 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-32a1972e-481f-43fb-9b70-f05b54151768 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:53.213809 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-32a1972e-481f-43fb-9b70-f05b54151768 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:53.214497 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-32a1972e-481f-43fb-9b70-f05b54151768 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:53.214950 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-32a1972e-481f-43fb-9b70-f05b54151768 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:53.215377 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-32a1972e-481f-43fb-9b70-f05b54151768 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:53.242273 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-32a1972e-481f-43fb-9b70-f05b54151768 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 9e1027c2-7a56-436c-9a65-ffaeac086d95] Going to try to terminate instance {{(pid=126852) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:06:53.319403 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-32a1972e-481f-43fb-9b70-f05b54151768 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9e1027c2-7a56-436c-9a65-ffaeac086d95" status: 204 len: 0 microversion: 2.1 time: 0.120646 Oct 03 15:06:53.320252 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 556/1146] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 3 15:06:53 2022] DELETE /compute/v2.1/servers/9e1027c2-7a56-436c-9a65-ffaeac086d95 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:06:53.329870 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-1e7aed5c-d171-4e4a-975f-a453bf651e4a tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:53.330585 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-1e7aed5c-d171-4e4a-975f-a453bf651e4a tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 9e1027c2-7a56-436c-9a65-ffaeac086d95] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:53.338179 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1e7aed5c-d171-4e4a-975f-a453bf651e4a tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:53.338660 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1e7aed5c-d171-4e4a-975f-a453bf651e4a tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:53.339099 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1e7aed5c-d171-4e4a-975f-a453bf651e4a tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:53.339793 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1e7aed5c-d171-4e4a-975f-a453bf651e4a tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:53.340250 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1e7aed5c-d171-4e4a-975f-a453bf651e4a tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:53.340685 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-1e7aed5c-d171-4e4a-975f-a453bf651e4a tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:53.468036 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-1e7aed5c-d171-4e4a-975f-a453bf651e4a tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba9bc42ba834887a018ea2b50fcf862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf939187436d4978a7805ab5aa91005a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:06:53.476326 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-1e7aed5c-d171-4e4a-975f-a453bf651e4a tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1027c2-7a56-436c-9a65-ffaeac086d95" status: 200 len: 1515 microversion: 2.1 time: 0.151346 Oct 03 15:06:53.476878 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 591/1147] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:53 2022] GET /compute/v2.1/servers/9e1027c2-7a56-436c-9a65-ffaeac086d95 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:54.500158 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-cdc3d23a-3f4d-4b57-9200-1eff4ec0393f tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:54.500781 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-cdc3d23a-3f4d-4b57-9200-1eff4ec0393f tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 9e1027c2-7a56-436c-9a65-ffaeac086d95] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:54.507091 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cdc3d23a-3f4d-4b57-9200-1eff4ec0393f tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:54.507573 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cdc3d23a-3f4d-4b57-9200-1eff4ec0393f tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:54.508012 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cdc3d23a-3f4d-4b57-9200-1eff4ec0393f tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:54.508701 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cdc3d23a-3f4d-4b57-9200-1eff4ec0393f tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:54.509158 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cdc3d23a-3f4d-4b57-9200-1eff4ec0393f tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:54.509607 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cdc3d23a-3f4d-4b57-9200-1eff4ec0393f tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:54.636887 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-cdc3d23a-3f4d-4b57-9200-1eff4ec0393f tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba9bc42ba834887a018ea2b50fcf862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf939187436d4978a7805ab5aa91005a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:06:54.644611 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-cdc3d23a-3f4d-4b57-9200-1eff4ec0393f tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1027c2-7a56-436c-9a65-ffaeac086d95" status: 200 len: 1515 microversion: 2.1 time: 0.148764 Oct 03 15:06:54.645172 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 557/1148] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:54 2022] GET /compute/v2.1/servers/9e1027c2-7a56-436c-9a65-ffaeac086d95 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:55.668047 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-6a4f5e2a-70c6-4d4c-848c-fef196564f9b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:55.668662 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-6a4f5e2a-70c6-4d4c-848c-fef196564f9b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 9e1027c2-7a56-436c-9a65-ffaeac086d95] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:55.675042 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6a4f5e2a-70c6-4d4c-848c-fef196564f9b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:55.675380 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6a4f5e2a-70c6-4d4c-848c-fef196564f9b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:55.675821 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6a4f5e2a-70c6-4d4c-848c-fef196564f9b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:55.676499 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6a4f5e2a-70c6-4d4c-848c-fef196564f9b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:55.677173 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6a4f5e2a-70c6-4d4c-848c-fef196564f9b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:55.677632 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6a4f5e2a-70c6-4d4c-848c-fef196564f9b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:55.716418 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-5f5cda28-2a7b-4e79-9978-e53de0f34653 req-166e60b6-0fd9-4538-96a5-e99498246a2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e1027c2-7a56-436c-9a65-ffaeac086d95", "name": "network-vif-deleted", "tag": "dbf28f4a-4055-44ed-9109-da33f7625589"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:06:55.727946 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-5f5cda28-2a7b-4e79-9978-e53de0f34653 req-166e60b6-0fd9-4538-96a5-e99498246a2a service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:55.728431 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-5f5cda28-2a7b-4e79-9978-e53de0f34653 req-166e60b6-0fd9-4538-96a5-e99498246a2a service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:55.729005 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-5f5cda28-2a7b-4e79-9978-e53de0f34653 req-166e60b6-0fd9-4538-96a5-e99498246a2a service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:55.740454 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-5f5cda28-2a7b-4e79-9978-e53de0f34653 req-166e60b6-0fd9-4538-96a5-e99498246a2a service nova] Creating event network-vif-deleted:dbf28f4a-4055-44ed-9109-da33f7625589 for instance 9e1027c2-7a56-436c-9a65-ffaeac086d95 on hv-cinder-85987 Oct 03 15:06:55.745387 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-6a4f5e2a-70c6-4d4c-848c-fef196564f9b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba9bc42ba834887a018ea2b50fcf862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf939187436d4978a7805ab5aa91005a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:06:55.752694 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-5f5cda28-2a7b-4e79-9978-e53de0f34653 req-166e60b6-0fd9-4538-96a5-e99498246a2a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040094 Oct 03 15:06:55.753300 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 558/1149] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 15:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:06:55.754572 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-6a4f5e2a-70c6-4d4c-848c-fef196564f9b tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1027c2-7a56-436c-9a65-ffaeac086d95" status: 200 len: 1473 microversion: 2.1 time: 0.090176 Oct 03 15:06:55.755141 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 592/1150] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:55 2022] GET /compute/v2.1/servers/9e1027c2-7a56-436c-9a65-ffaeac086d95 => generated 1473 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:06:56.777447 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-45c61c97-64d7-4d43-b94c-5af2097d3851 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:56.778184 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-45c61c97-64d7-4d43-b94c-5af2097d3851 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] [instance: 9e1027c2-7a56-436c-9a65-ffaeac086d95] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:56.784283 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-45c61c97-64d7-4d43-b94c-5af2097d3851 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:56.784768 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-45c61c97-64d7-4d43-b94c-5af2097d3851 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:56.785213 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-45c61c97-64d7-4d43-b94c-5af2097d3851 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:56.785941 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-45c61c97-64d7-4d43-b94c-5af2097d3851 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:56.786397 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-45c61c97-64d7-4d43-b94c-5af2097d3851 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:56.786821 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-45c61c97-64d7-4d43-b94c-5af2097d3851 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:56.800186 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.wsgi [None req-45c61c97-64d7-4d43-b94c-5af2097d3851 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] HTTP exception thrown: Instance 9e1027c2-7a56-436c-9a65-ffaeac086d95 could not be found. Oct 03 15:06:56.801805 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-45c61c97-64d7-4d43-b94c-5af2097d3851 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Request method failure captured: Oct 03 15:06:56.801805 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: request: GET /compute/v2.1/servers/9e1027c2-7a56-436c-9a65-ffaeac086d95 HTTP/1.1 Oct 03 15:06:56.801805 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept: application/json Oct 03 15:06:56.801805 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept-Encoding: identity Oct 03 15:06:56.801805 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Connection: close Oct 03 15:06:56.801805 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Length: 0 Oct 03 15:06:56.801805 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Type: application/json Oct 03 15:06:56.801805 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Host: 10.222.0.46 Oct 03 15:06:56.801805 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Openstack-System-Scope: None Oct 03 15:06:56.801805 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: User-Agent: python-urllib3/1.26.12 Oct 03 15:06:56.801805 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Auth-Token: gAAAAABjOvoczFjF1fHhVIJj9yEQNi616VmdOQMLUIhD53nE2fT2zG7Hy3zBTQHkw4NUjyb-H-sM6U77eNYEpWQBYyuFW7RasYl42JrTkAwmP-DR0mrtvF1KrMXOfoJGK05VmhDacBYulYvdld2SHApCZ_raGkNpSjVqqV87HbcBPt2weW-3UvM Oct 03 15:06:56.801805 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Id: None Oct 03 15:06:56.801805 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Name: None Oct 03 15:06:56.801805 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Identity-Status: Confirmed Oct 03 15:06:56.801805 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Is-Admin-Project: True Oct 03 15:06:56.801805 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Id: default Oct 03 15:06:56.801805 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Name: Default Oct 03 15:06:56.801805 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Id: cf939187436d4978a7805ab5aa91005a Oct 03 15:06:56.801805 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Name: tempest-VolumesSnapshotTestJSON-56307656 Oct 03 15:06:56.801805 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Role: member,reader Oct 03 15:06:56.801805 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Roles: member,reader Oct 03 15:06:56.804339 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cf939187436d4978a7805ab5aa91005a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_cf939187436d4978a7805ab5aa91005a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cf939187436d4978a7805ab5aa91005a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/cf939187436d4978a7805ab5aa91005a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 15:06:56.804339 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant: tempest-VolumesSnapshotTestJSON-56307656 Oct 03 15:06:56.804339 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Id: cf939187436d4978a7805ab5aa91005a Oct 03 15:06:56.804339 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-56307656 Oct 03 15:06:56.804339 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User: tempest-VolumesSnapshotTestJSON-56307656-project Oct 03 15:06:56.804339 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Id: default Oct 03 15:06:56.804339 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Name: Default Oct 03 15:06:56.804339 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Id: fba9bc42ba834887a018ea2b50fcf862 Oct 03 15:06:56.804339 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Name: tempest-VolumesSnapshotTestJSON-56307656-project Oct 03 15:06:56.804339 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: method: > Oct 03 15:06:56.804339 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: exception: Instance 9e1027c2-7a56-436c-9a65-ffaeac086d95 could not be found. Oct 03 15:06:56.804339 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: action_args: {'id': '9e1027c2-7a56-436c-9a65-ffaeac086d95'} Oct 03 15:06:56.805353 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:06:56.805353 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:06:56.805353 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:06:56.805353 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:06:56.805353 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:06:56.805353 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:06:56.805353 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:06:56.805353 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:06:56.805353 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:06:56.805353 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:06:56.805353 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e1027c2-7a56-436c-9a65-ffaeac086d95 could not be found. Oct 03 15:06:56.805353 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:06:56.805353 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:06:56.805353 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:06:56.805353 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:06:56.805353 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:06:56.805353 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:06:56.805353 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:06:56.805353 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:06:56.805353 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:06:56.807123 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:06:56.807123 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:06:56.807123 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:06:56.807123 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:06:56.807123 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:06:56.807123 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:06:56.807123 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:06:56.807123 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e1027c2-7a56-436c-9a65-ffaeac086d95 could not be found. Oct 03 15:06:56.807123 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:06:56.807123 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:06:56.807123 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:06:56.807123 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:06:56.807123 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:06:56.807123 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:06:56.807123 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:06:56.807123 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:06:56.807123 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e1027c2-7a56-436c-9a65-ffaeac086d95 could not be found. Oct 03 15:06:56.807123 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:06:56.808692 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-45c61c97-64d7-4d43-b94c-5af2097d3851 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] Returning 404 to user: Instance 9e1027c2-7a56-436c-9a65-ffaeac086d95 could not be found. {{(pid=126852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:06:56.808692 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-45c61c97-64d7-4d43-b94c-5af2097d3851 tempest-VolumesSnapshotTestJSON-56307656 tempest-VolumesSnapshotTestJSON-56307656-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1027c2-7a56-436c-9a65-ffaeac086d95" status: 404 len: 111 microversion: 2.1 time: 0.030352 Oct 03 15:06:56.808692 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 559/1151] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:56 2022] GET /compute/v2.1/servers/9e1027c2-7a56-436c-9a65-ffaeac086d95 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 15:07:40.644438 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-0d2da1bb-4ba5-472d-8098-2af04f58327c tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Action: 'create', calling method: .version_select at 0x7fe0d3691160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-77994264", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIofx0vGglF7gaSX2dMsqI09t4NyuWIS5nS2WA8vqEdjMbGbuTVs4NwSyRvKs75PEdqOCwWGYHY0mLiI50gpq/IheSJwjvBMLXvweteu/VmxBvCl73EqEgH64MBmx3UKqw=="}} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:07:40.650259 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_api:SELECT=6 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:07:40.650904 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=1 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:07:40.663673 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.quota [None req-0d2da1bb-4ba5-472d-8098-2af04f58327c tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Getting quotas for project 1b1db654fb9f4320ade1ca90e5000e09. Resources: {'key_pairs'} {{(pid=126851) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:07:40.667320 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.quota [None req-0d2da1bb-4ba5-472d-8098-2af04f58327c tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Getting quotas for user 12ee625591a14362a520aaad99db4ba8 and project 1b1db654fb9f4320ade1ca90e5000e09. Resources: {'key_pairs'} {{(pid=126851) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:07:40.691344 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-0d2da1bb-4ba5-472d-8098-2af04f58327c tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.050758 Oct 03 15:07:40.691924 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 593/1152] 10.222.0.46 () {60 vars in 1159 bytes} [Mon Oct 3 15:07:40 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:07:40.743145 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-3560ab56-0e22-4b14-87f0-0873d231ebd3 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1108553679", "imageRef": "076f208d-d4f1-4a42-9d46-20c276f7cf7f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-77994264", "networks": [{"uuid": "535a5116-7d3b-43cd-8377-22a0ad6e55c7"}]}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:07:40.751635 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:07:40.752266 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:07:40.901720 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.network.neutron [None req-3560ab56-0e22-4b14-87f0-0873d231ebd3 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] validate_networks() for [('535a5116-7d3b-43cd-8377-22a0ad6e55c7', None, None, None, None, None)] {{(pid=126852) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:07:41.272820 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-3560ab56-0e22-4b14-87f0-0873d231ebd3 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Flavor limits 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:07:41.273245 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-3560ab56-0e22-4b14-87f0-0873d231ebd3 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Image limits 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:07:41.273760 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-3560ab56-0e22-4b14-87f0-0873d231ebd3 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Flavor pref 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:07:41.274168 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-3560ab56-0e22-4b14-87f0-0873d231ebd3 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Image pref 0:0:0 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:07:41.274579 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.virt.hardware [None req-3560ab56-0e22-4b14-87f0-0873d231ebd3 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:07:41.283641 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3560ab56-0e22-4b14-87f0-0873d231ebd3 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:41.284128 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3560ab56-0e22-4b14-87f0-0873d231ebd3 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:41.284564 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3560ab56-0e22-4b14-87f0-0873d231ebd3 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:41.285289 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3560ab56-0e22-4b14-87f0-0873d231ebd3 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:41.285770 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3560ab56-0e22-4b14-87f0-0873d231ebd3 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:41.286199 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-3560ab56-0e22-4b14-87f0-0873d231ebd3 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:41.304110 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-3560ab56-0e22-4b14-87f0-0873d231ebd3 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Getting quotas for project 1b1db654fb9f4320ade1ca90e5000e09. Resources: {'ram', 'instances', 'cores'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:07:41.308014 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.quota [None req-3560ab56-0e22-4b14-87f0-0873d231ebd3 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Getting quotas for user 12ee625591a14362a520aaad99db4ba8 and project 1b1db654fb9f4320ade1ca90e5000e09. Resources: {'ram', 'instances', 'cores'} {{(pid=126852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:07:41.318812 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-3560ab56-0e22-4b14-87f0-0873d231ebd3 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Going to run 1 instances... {{(pid=126852) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:07:41.321035 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-3560ab56-0e22-4b14-87f0-0873d231ebd3 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='076f208d-d4f1-4a42-9d46-20c276f7cf7f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:07:41.365749 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-3560ab56-0e22-4b14-87f0-0873d231ebd3 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.626959 Oct 03 15:07:41.366330 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 560/1153] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 3 15:07:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:07:41.377067 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-dbad51c6-1963-457c-bc4e-e2ee3f7ca8a9 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:41.377708 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-dbad51c6-1963-457c-bc4e-e2ee3f7ca8a9 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:41.530765 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-dbad51c6-1963-457c-bc4e-e2ee3f7ca8a9 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ee625591a14362a520aaad99db4ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:07:41.538422 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-dbad51c6-1963-457c-bc4e-e2ee3f7ca8a9 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 200 len: 1257 microversion: 2.1 time: 0.165145 Oct 03 15:07:41.538993 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 594/1154] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:41 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 1257 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:07:42.560837 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-5891a33f-805c-4e33-9fe5-2853150ee70f tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:42.561451 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-5891a33f-805c-4e33-9fe5-2853150ee70f tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:42.570815 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5891a33f-805c-4e33-9fe5-2853150ee70f tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:42.571403 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5891a33f-805c-4e33-9fe5-2853150ee70f tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:42.571905 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5891a33f-805c-4e33-9fe5-2853150ee70f tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:42.572668 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5891a33f-805c-4e33-9fe5-2853150ee70f tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:42.573193 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5891a33f-805c-4e33-9fe5-2853150ee70f tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:42.573727 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5891a33f-805c-4e33-9fe5-2853150ee70f tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:42.635157 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-5891a33f-805c-4e33-9fe5-2853150ee70f tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ee625591a14362a520aaad99db4ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:07:42.644416 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-5891a33f-805c-4e33-9fe5-2853150ee70f tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 200 len: 1315 microversion: 2.1 time: 0.088006 Oct 03 15:07:42.645303 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 561/1155] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:42 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 1315 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:07:43.671431 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-aff0cb6d-b43a-4769-b9a4-7b274aa7f441 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:43.671431 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-aff0cb6d-b43a-4769-b9a4-7b274aa7f441 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:43.679611 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-aff0cb6d-b43a-4769-b9a4-7b274aa7f441 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:43.680093 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-aff0cb6d-b43a-4769-b9a4-7b274aa7f441 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:43.680527 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-aff0cb6d-b43a-4769-b9a4-7b274aa7f441 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:43.681228 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-aff0cb6d-b43a-4769-b9a4-7b274aa7f441 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:43.681713 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-aff0cb6d-b43a-4769-b9a4-7b274aa7f441 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:43.682141 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-aff0cb6d-b43a-4769-b9a4-7b274aa7f441 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:43.826195 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-aff0cb6d-b43a-4769-b9a4-7b274aa7f441 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ee625591a14362a520aaad99db4ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:07:43.834242 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-aff0cb6d-b43a-4769-b9a4-7b274aa7f441 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 200 len: 1357 microversion: 2.1 time: 0.169241 Oct 03 15:07:43.835016 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 595/1156] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:43 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:07:44.858549 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-17afe95b-4329-4757-9619-068e92b3a96b tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:44.859452 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-17afe95b-4329-4757-9619-068e92b3a96b tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:44.868001 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-17afe95b-4329-4757-9619-068e92b3a96b tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:44.868493 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-17afe95b-4329-4757-9619-068e92b3a96b tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:44.868922 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-17afe95b-4329-4757-9619-068e92b3a96b tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:44.869725 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-17afe95b-4329-4757-9619-068e92b3a96b tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:44.870177 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-17afe95b-4329-4757-9619-068e92b3a96b tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:44.870601 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-17afe95b-4329-4757-9619-068e92b3a96b tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:45.019448 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-17afe95b-4329-4757-9619-068e92b3a96b tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ee625591a14362a520aaad99db4ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:07:45.027901 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-17afe95b-4329-4757-9619-068e92b3a96b tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 200 len: 1357 microversion: 2.1 time: 0.173821 Oct 03 15:07:45.028508 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 562/1157] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:44 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:07:46.051028 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-9de6b2ed-754c-498b-9c56-93c066626131 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:46.051585 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-9de6b2ed-754c-498b-9c56-93c066626131 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:46.058695 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9de6b2ed-754c-498b-9c56-93c066626131 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:46.059223 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9de6b2ed-754c-498b-9c56-93c066626131 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:46.059660 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9de6b2ed-754c-498b-9c56-93c066626131 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:46.060355 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9de6b2ed-754c-498b-9c56-93c066626131 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:46.061018 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9de6b2ed-754c-498b-9c56-93c066626131 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:46.061486 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-9de6b2ed-754c-498b-9c56-93c066626131 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:46.208431 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-9de6b2ed-754c-498b-9c56-93c066626131 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ee625591a14362a520aaad99db4ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:07:46.217386 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-9de6b2ed-754c-498b-9c56-93c066626131 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 200 len: 1357 microversion: 2.1 time: 0.170150 Oct 03 15:07:46.234642 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 596/1158] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:46 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 1357 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:07:47.242543 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-bdcd7c36-96bc-44e3-9b4b-6244653c64e5 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:47.243158 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-bdcd7c36-96bc-44e3-9b4b-6244653c64e5 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:47.249520 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bdcd7c36-96bc-44e3-9b4b-6244653c64e5 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:47.250017 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bdcd7c36-96bc-44e3-9b4b-6244653c64e5 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:47.250451 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bdcd7c36-96bc-44e3-9b4b-6244653c64e5 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:47.251137 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bdcd7c36-96bc-44e3-9b4b-6244653c64e5 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:47.251593 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bdcd7c36-96bc-44e3-9b4b-6244653c64e5 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:47.252015 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-bdcd7c36-96bc-44e3-9b4b-6244653c64e5 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:47.408220 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-bdcd7c36-96bc-44e3-9b4b-6244653c64e5 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ee625591a14362a520aaad99db4ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:07:47.418077 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-bdcd7c36-96bc-44e3-9b4b-6244653c64e5 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 200 len: 1357 microversion: 2.1 time: 0.180210 Oct 03 15:07:47.418662 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 563/1159] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:47 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:07:48.447976 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-c9775c70-f87c-4033-96c9-7dda3bc56083 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:48.448668 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-c9775c70-f87c-4033-96c9-7dda3bc56083 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:48.455230 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c9775c70-f87c-4033-96c9-7dda3bc56083 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:48.456736 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c9775c70-f87c-4033-96c9-7dda3bc56083 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:48.456736 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c9775c70-f87c-4033-96c9-7dda3bc56083 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:48.457027 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c9775c70-f87c-4033-96c9-7dda3bc56083 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:48.457490 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c9775c70-f87c-4033-96c9-7dda3bc56083 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:48.457942 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-c9775c70-f87c-4033-96c9-7dda3bc56083 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:48.607149 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-c9775c70-f87c-4033-96c9-7dda3bc56083 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ee625591a14362a520aaad99db4ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:07:48.615089 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-c9775c70-f87c-4033-96c9-7dda3bc56083 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 200 len: 1357 microversion: 2.1 time: 0.172181 Oct 03 15:07:48.616327 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 597/1160] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:48 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:07:49.638310 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-ba707748-9a91-45b1-ab8f-5c832fc1720d tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:49.638922 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-ba707748-9a91-45b1-ab8f-5c832fc1720d tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:49.645409 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ba707748-9a91-45b1-ab8f-5c832fc1720d tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:49.645950 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ba707748-9a91-45b1-ab8f-5c832fc1720d tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:49.646384 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ba707748-9a91-45b1-ab8f-5c832fc1720d tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:49.647594 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ba707748-9a91-45b1-ab8f-5c832fc1720d tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:49.648042 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ba707748-9a91-45b1-ab8f-5c832fc1720d tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:49.648462 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-ba707748-9a91-45b1-ab8f-5c832fc1720d tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:49.786897 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-ba707748-9a91-45b1-ab8f-5c832fc1720d tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ee625591a14362a520aaad99db4ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:07:49.795114 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-ba707748-9a91-45b1-ab8f-5c832fc1720d tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 200 len: 1357 microversion: 2.1 time: 0.160728 Oct 03 15:07:49.795677 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 564/1161] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:49 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:07:50.818210 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-202b3132-b34f-4527-95d3-22f1e7b3ad87 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:50.818886 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-202b3132-b34f-4527-95d3-22f1e7b3ad87 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:50.825339 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-202b3132-b34f-4527-95d3-22f1e7b3ad87 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:50.825859 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-202b3132-b34f-4527-95d3-22f1e7b3ad87 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:50.826301 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-202b3132-b34f-4527-95d3-22f1e7b3ad87 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:50.826989 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-202b3132-b34f-4527-95d3-22f1e7b3ad87 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:50.827449 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-202b3132-b34f-4527-95d3-22f1e7b3ad87 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:50.827875 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-202b3132-b34f-4527-95d3-22f1e7b3ad87 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:50.950538 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-202b3132-b34f-4527-95d3-22f1e7b3ad87 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ee625591a14362a520aaad99db4ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:07:50.957975 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-202b3132-b34f-4527-95d3-22f1e7b3ad87 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 200 len: 1357 microversion: 2.1 time: 0.143635 Oct 03 15:07:50.958531 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 598/1162] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:50 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 1357 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:07:51.981795 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-8cfbfec6-33ca-4462-8c3a-2b9c5bd53c76 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:51.982388 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-8cfbfec6-33ca-4462-8c3a-2b9c5bd53c76 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:51.984645 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell0:SELECT=2 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:07:51.985306 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell0:SELECT=6 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:07:51.991094 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8cfbfec6-33ca-4462-8c3a-2b9c5bd53c76 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:51.991580 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8cfbfec6-33ca-4462-8c3a-2b9c5bd53c76 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:51.992025 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8cfbfec6-33ca-4462-8c3a-2b9c5bd53c76 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:51.992732 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8cfbfec6-33ca-4462-8c3a-2b9c5bd53c76 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:51.993186 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8cfbfec6-33ca-4462-8c3a-2b9c5bd53c76 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:51.993637 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8cfbfec6-33ca-4462-8c3a-2b9c5bd53c76 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:52.119328 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-8cfbfec6-33ca-4462-8c3a-2b9c5bd53c76 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ee625591a14362a520aaad99db4ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:07:52.126915 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-8cfbfec6-33ca-4462-8c3a-2b9c5bd53c76 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 200 len: 1357 microversion: 2.1 time: 0.149118 Oct 03 15:07:52.127481 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 565/1163] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:51 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:07:53.150061 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-6200de12-a8e0-440e-8a01-3603062d28af tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:53.150622 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-6200de12-a8e0-440e-8a01-3603062d28af tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:53.152383 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell0:SELECT=6 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:07:53.158379 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6200de12-a8e0-440e-8a01-3603062d28af tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:53.158864 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6200de12-a8e0-440e-8a01-3603062d28af tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:53.159299 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6200de12-a8e0-440e-8a01-3603062d28af tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:53.159991 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6200de12-a8e0-440e-8a01-3603062d28af tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:53.160442 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6200de12-a8e0-440e-8a01-3603062d28af tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:53.160863 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-6200de12-a8e0-440e-8a01-3603062d28af tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:53.394247 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-6200de12-a8e0-440e-8a01-3603062d28af tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ee625591a14362a520aaad99db4ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:07:53.401952 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-6200de12-a8e0-440e-8a01-3603062d28af tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 200 len: 1357 microversion: 2.1 time: 0.256451 Oct 03 15:07:53.402458 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 599/1164] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:53 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 1357 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:07:53.591402 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-6aac1b9d-b8c7-4bf8-83fe-fad0a1307ed0 req-19a5aa6f-83ac-46dd-ba92-9a25a40080a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aef86e9-856d-47fb-bf23-81fc98b2511c", "tag": "fa31ad88-f4bc-44fb-9cce-f4956eec436b"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:07:53.603071 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-6aac1b9d-b8c7-4bf8-83fe-fad0a1307ed0 req-19a5aa6f-83ac-46dd-ba92-9a25a40080a7 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:53.603561 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-6aac1b9d-b8c7-4bf8-83fe-fad0a1307ed0 req-19a5aa6f-83ac-46dd-ba92-9a25a40080a7 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:53.604025 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-6aac1b9d-b8c7-4bf8-83fe-fad0a1307ed0 req-19a5aa6f-83ac-46dd-ba92-9a25a40080a7 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:53.616628 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-6aac1b9d-b8c7-4bf8-83fe-fad0a1307ed0 req-19a5aa6f-83ac-46dd-ba92-9a25a40080a7 service nova] Creating event network-changed:fa31ad88-f4bc-44fb-9cce-f4956eec436b for instance 3aef86e9-856d-47fb-bf23-81fc98b2511c on hv-cinder-85987 Oct 03 15:07:53.621529 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-6aac1b9d-b8c7-4bf8-83fe-fad0a1307ed0 req-19a5aa6f-83ac-46dd-ba92-9a25a40080a7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034107 Oct 03 15:07:53.622142 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 566/1165] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 15:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:07:54.424483 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-85def533-f5d9-4ee8-bd9b-93e049436ebb tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:54.425088 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-85def533-f5d9-4ee8-bd9b-93e049436ebb tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:54.431565 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-85def533-f5d9-4ee8-bd9b-93e049436ebb tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:54.432037 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-85def533-f5d9-4ee8-bd9b-93e049436ebb tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:54.432466 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-85def533-f5d9-4ee8-bd9b-93e049436ebb tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:54.433152 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-85def533-f5d9-4ee8-bd9b-93e049436ebb tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:54.433634 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-85def533-f5d9-4ee8-bd9b-93e049436ebb tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:54.434053 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-85def533-f5d9-4ee8-bd9b-93e049436ebb tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:54.556696 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-85def533-f5d9-4ee8-bd9b-93e049436ebb tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ee625591a14362a520aaad99db4ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:07:54.564854 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-85def533-f5d9-4ee8-bd9b-93e049436ebb tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 200 len: 1357 microversion: 2.1 time: 0.144191 Oct 03 15:07:54.565413 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 600/1166] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:54 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 1357 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:07:55.589144 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-da392e42-5ac9-46ac-ae01-366bdb120a24 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:55.589782 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-da392e42-5ac9-46ac-ae01-366bdb120a24 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:55.595961 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-da392e42-5ac9-46ac-ae01-366bdb120a24 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:55.596448 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-da392e42-5ac9-46ac-ae01-366bdb120a24 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:55.596883 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-da392e42-5ac9-46ac-ae01-366bdb120a24 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:55.597603 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-da392e42-5ac9-46ac-ae01-366bdb120a24 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:55.598092 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-da392e42-5ac9-46ac-ae01-366bdb120a24 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:55.598519 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-da392e42-5ac9-46ac-ae01-366bdb120a24 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:55.727987 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-da392e42-5ac9-46ac-ae01-366bdb120a24 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ee625591a14362a520aaad99db4ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:07:55.735645 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-da392e42-5ac9-46ac-ae01-366bdb120a24 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 200 len: 1357 microversion: 2.1 time: 0.152010 Oct 03 15:07:55.736208 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 567/1167] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:55 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:07:56.758264 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-8aef896d-9d90-4c6e-9473-907c7962171b tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:56.758798 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-8aef896d-9d90-4c6e-9473-907c7962171b tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:56.765146 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8aef896d-9d90-4c6e-9473-907c7962171b tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:56.765694 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8aef896d-9d90-4c6e-9473-907c7962171b tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:56.766138 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8aef896d-9d90-4c6e-9473-907c7962171b tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:56.766827 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8aef896d-9d90-4c6e-9473-907c7962171b tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:56.767280 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8aef896d-9d90-4c6e-9473-907c7962171b tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:56.767703 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-8aef896d-9d90-4c6e-9473-907c7962171b tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:56.891313 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-8aef896d-9d90-4c6e-9473-907c7962171b tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ee625591a14362a520aaad99db4ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:07:56.898916 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-8aef896d-9d90-4c6e-9473-907c7962171b tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 200 len: 1357 microversion: 2.1 time: 0.144608 Oct 03 15:07:56.899473 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 601/1168] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:56 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 1357 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:07:57.921803 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-5bc33468-853b-4deb-a24e-0d9b7af20fba tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:57.922391 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-5bc33468-853b-4deb-a24e-0d9b7af20fba tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:57.929361 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5bc33468-853b-4deb-a24e-0d9b7af20fba tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:57.929876 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5bc33468-853b-4deb-a24e-0d9b7af20fba tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:57.930316 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5bc33468-853b-4deb-a24e-0d9b7af20fba tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:57.931006 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5bc33468-853b-4deb-a24e-0d9b7af20fba tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:57.931451 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5bc33468-853b-4deb-a24e-0d9b7af20fba tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:57.931869 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5bc33468-853b-4deb-a24e-0d9b7af20fba tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:58.064529 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-5bc33468-853b-4deb-a24e-0d9b7af20fba tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ee625591a14362a520aaad99db4ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:07:58.072953 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-5bc33468-853b-4deb-a24e-0d9b7af20fba tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 200 len: 1357 microversion: 2.1 time: 0.154963 Oct 03 15:07:58.073540 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 568/1169] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:57 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:07:59.095510 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-159f8203-c159-4774-9162-b850c7c3aa98 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:59.096132 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-159f8203-c159-4774-9162-b850c7c3aa98 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:59.102676 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-159f8203-c159-4774-9162-b850c7c3aa98 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:59.103166 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-159f8203-c159-4774-9162-b850c7c3aa98 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:59.103607 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-159f8203-c159-4774-9162-b850c7c3aa98 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:59.104297 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-159f8203-c159-4774-9162-b850c7c3aa98 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:59.104756 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-159f8203-c159-4774-9162-b850c7c3aa98 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:59.105183 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-159f8203-c159-4774-9162-b850c7c3aa98 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:59.494831 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-159f8203-c159-4774-9162-b850c7c3aa98 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ee625591a14362a520aaad99db4ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:07:59.502375 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-159f8203-c159-4774-9162-b850c7c3aa98 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 200 len: 1357 microversion: 2.1 time: 0.410742 Oct 03 15:07:59.502936 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 602/1170] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:59 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 1357 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:08:00.123307 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-9c68ba44-2d1c-4807-80b7-45fb5de84355 req-6a7f9d5b-3d47-4e5f-a723-d9bd1e74e6e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aef86e9-856d-47fb-bf23-81fc98b2511c", "name": "network-vif-plugged", "status": "completed", "tag": "fa31ad88-f4bc-44fb-9cce-f4956eec436b"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:08:00.134893 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-9c68ba44-2d1c-4807-80b7-45fb5de84355 req-6a7f9d5b-3d47-4e5f-a723-d9bd1e74e6e4 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:00.135370 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-9c68ba44-2d1c-4807-80b7-45fb5de84355 req-6a7f9d5b-3d47-4e5f-a723-d9bd1e74e6e4 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:00.136069 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-9c68ba44-2d1c-4807-80b7-45fb5de84355 req-6a7f9d5b-3d47-4e5f-a723-d9bd1e74e6e4 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:00.147699 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-9c68ba44-2d1c-4807-80b7-45fb5de84355 req-6a7f9d5b-3d47-4e5f-a723-d9bd1e74e6e4 service nova] Creating event network-vif-plugged:fa31ad88-f4bc-44fb-9cce-f4956eec436b for instance 3aef86e9-856d-47fb-bf23-81fc98b2511c on hv-cinder-85987 Oct 03 15:08:00.153074 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-9c68ba44-2d1c-4807-80b7-45fb5de84355 req-6a7f9d5b-3d47-4e5f-a723-d9bd1e74e6e4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033602 Oct 03 15:08:00.154357 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 569/1171] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 15:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:08:00.525951 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-5e28e590-4173-4a6a-b819-079c8285e8a8 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:00.526563 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-5e28e590-4173-4a6a-b819-079c8285e8a8 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:00.532935 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5e28e590-4173-4a6a-b819-079c8285e8a8 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:00.533414 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5e28e590-4173-4a6a-b819-079c8285e8a8 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:00.533883 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5e28e590-4173-4a6a-b819-079c8285e8a8 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:00.534565 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5e28e590-4173-4a6a-b819-079c8285e8a8 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:00.535019 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5e28e590-4173-4a6a-b819-079c8285e8a8 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:00.535442 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-5e28e590-4173-4a6a-b819-079c8285e8a8 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:00.659900 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-5e28e590-4173-4a6a-b819-079c8285e8a8 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ee625591a14362a520aaad99db4ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:08:00.667410 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-5e28e590-4173-4a6a-b819-079c8285e8a8 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 200 len: 1357 microversion: 2.1 time: 0.145945 Oct 03 15:08:00.667976 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 603/1172] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:00 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:08:01.690283 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-243ded53-8803-462b-9316-ff230253b8f7 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:01.690973 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-243ded53-8803-462b-9316-ff230253b8f7 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:01.697448 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-243ded53-8803-462b-9316-ff230253b8f7 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:01.697992 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-243ded53-8803-462b-9316-ff230253b8f7 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:01.698427 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-243ded53-8803-462b-9316-ff230253b8f7 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:01.699117 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-243ded53-8803-462b-9316-ff230253b8f7 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:01.699558 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-243ded53-8803-462b-9316-ff230253b8f7 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:01.699978 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-243ded53-8803-462b-9316-ff230253b8f7 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:01.824490 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-243ded53-8803-462b-9316-ff230253b8f7 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ee625591a14362a520aaad99db4ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:08:01.832037 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-243ded53-8803-462b-9316-ff230253b8f7 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 200 len: 1357 microversion: 2.1 time: 0.145960 Oct 03 15:08:01.832599 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 570/1173] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:01 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:08:02.856132 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-d1c53ff1-eb0f-4adf-988d-5c3b9c8309db tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:02.856686 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-d1c53ff1-eb0f-4adf-988d-5c3b9c8309db tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:02.863107 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d1c53ff1-eb0f-4adf-988d-5c3b9c8309db tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:02.863581 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d1c53ff1-eb0f-4adf-988d-5c3b9c8309db tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:02.864008 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d1c53ff1-eb0f-4adf-988d-5c3b9c8309db tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:02.864690 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d1c53ff1-eb0f-4adf-988d-5c3b9c8309db tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:02.865766 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d1c53ff1-eb0f-4adf-988d-5c3b9c8309db tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:02.866190 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d1c53ff1-eb0f-4adf-988d-5c3b9c8309db tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:02.994803 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-d1c53ff1-eb0f-4adf-988d-5c3b9c8309db tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ee625591a14362a520aaad99db4ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:08:03.002743 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-d1c53ff1-eb0f-4adf-988d-5c3b9c8309db tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 200 len: 1547 microversion: 2.1 time: 0.150510 Oct 03 15:08:03.003321 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 604/1174] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:02 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:08:03.024506 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-37cf4a50-5570-4356-8ab2-31877f1a973a tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:03.025149 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-37cf4a50-5570-4356-8ab2-31877f1a973a tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:03.031326 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-37cf4a50-5570-4356-8ab2-31877f1a973a tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:03.031811 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-37cf4a50-5570-4356-8ab2-31877f1a973a tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:03.032248 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-37cf4a50-5570-4356-8ab2-31877f1a973a tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:03.032941 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-37cf4a50-5570-4356-8ab2-31877f1a973a tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:03.033397 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-37cf4a50-5570-4356-8ab2-31877f1a973a tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:03.033851 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-37cf4a50-5570-4356-8ab2-31877f1a973a tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:03.160819 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-37cf4a50-5570-4356-8ab2-31877f1a973a tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ee625591a14362a520aaad99db4ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:08:03.169031 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-37cf4a50-5570-4356-8ab2-31877f1a973a tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 200 len: 1547 microversion: 2.1 time: 0.148423 Oct 03 15:08:03.169626 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 571/1175] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:03 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 1547 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:08:03.190642 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-d5a8b9ea-543c-41f4-ba96-f8ace67db572 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:03.195714 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-d5a8b9ea-543c-41f4-ba96-f8ace67db572 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12ee625591a14362a520aaad99db4ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:08:03.196476 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-d5a8b9ea-543c-41f4-ba96-f8ace67db572 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Searching by: {'deleted': False, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09'} {{(pid=126851) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 15:08:03.203082 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d5a8b9ea-543c-41f4-ba96-f8ace67db572 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:03.203561 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d5a8b9ea-543c-41f4-ba96-f8ace67db572 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:03.203998 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d5a8b9ea-543c-41f4-ba96-f8ace67db572 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:03.204720 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d5a8b9ea-543c-41f4-ba96-f8ace67db572 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:03.205173 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d5a8b9ea-543c-41f4-ba96-f8ace67db572 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:03.205637 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d5a8b9ea-543c-41f4-ba96-f8ace67db572 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:03.295913 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.multi_cell_list [None req-d5a8b9ea-543c-41f4-ba96-f8ace67db572 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126851) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 15:08:03.386410 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-d5a8b9ea-543c-41f4-ba96-f8ace67db572 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.199459 Oct 03 15:08:03.386917 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 605/1176] 10.222.0.46 () {58 vars in 1125 bytes} [Mon Oct 3 15:08:03 2022] GET /compute/v2.1/servers => generated 343 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:08:03.399877 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-67138427-e800-4cc1-a21c-5407407f059e tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:03.400494 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-67138427-e800-4cc1-a21c-5407407f059e tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:03.406343 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-67138427-e800-4cc1-a21c-5407407f059e tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:03.406825 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-67138427-e800-4cc1-a21c-5407407f059e tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:03.407268 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-67138427-e800-4cc1-a21c-5407407f059e tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:03.407956 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-67138427-e800-4cc1-a21c-5407407f059e tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:03.408411 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-67138427-e800-4cc1-a21c-5407407f059e tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:03.408832 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-67138427-e800-4cc1-a21c-5407407f059e tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:03.533542 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-67138427-e800-4cc1-a21c-5407407f059e tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ee625591a14362a520aaad99db4ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:08:03.541137 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-67138427-e800-4cc1-a21c-5407407f059e tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 200 len: 1547 microversion: 2.1 time: 0.145675 Oct 03 15:08:03.541728 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 572/1177] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:03 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 1547 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:08:05.076379 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-b7629d1d-2876-43d1-8ed2-2a505fdfd49e tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52445fed-abd7-4e35-9861-4c834b9514bd"}} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:08:05.078813 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-b7629d1d-2876-43d1-8ed2-2a505fdfd49e tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:05.085799 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b7629d1d-2876-43d1-8ed2-2a505fdfd49e tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:05.086274 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b7629d1d-2876-43d1-8ed2-2a505fdfd49e tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:05.086706 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b7629d1d-2876-43d1-8ed2-2a505fdfd49e tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:05.087387 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b7629d1d-2876-43d1-8ed2-2a505fdfd49e tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:05.087834 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b7629d1d-2876-43d1-8ed2-2a505fdfd49e tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:05.088255 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b7629d1d-2876-43d1-8ed2-2a505fdfd49e tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:05.343106 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-b7629d1d-2876-43d1-8ed2-2a505fdfd49e tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "POST /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270493 Oct 03 15:08:05.343710 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 606/1178] 10.222.0.46 () {60 vars in 1323 bytes} [Mon Oct 3 15:08:05 2022] POST /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:08:12.936925 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-5ce40bb4-4ee1-4660-adba-575a436c8305 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:12.937546 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-5ce40bb4-4ee1-4660-adba-575a436c8305 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:12.939957 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:08:12.946769 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5ce40bb4-4ee1-4660-adba-575a436c8305 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:12.947380 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5ce40bb4-4ee1-4660-adba-575a436c8305 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:12.947811 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5ce40bb4-4ee1-4660-adba-575a436c8305 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:12.948496 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5ce40bb4-4ee1-4660-adba-575a436c8305 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:12.949101 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5ce40bb4-4ee1-4660-adba-575a436c8305 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:12.949545 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-5ce40bb4-4ee1-4660-adba-575a436c8305 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:12.953895 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=67 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:08:13.090563 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-5ce40bb4-4ee1-4660-adba-575a436c8305 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ee625591a14362a520aaad99db4ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:08:13.098702 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-5ce40bb4-4ee1-4660-adba-575a436c8305 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 200 len: 1593 microversion: 2.1 time: 0.165536 Oct 03 15:08:13.099265 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 573/1179] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:12 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 1593 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:08:14.671077 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell0:SELECT=2 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:08:14.675554 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-6875173b-4208-4954-a898-cae7b7e79201 req-ddcd540b-f7ec-4009-bc3b-072d8b802b3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aef86e9-856d-47fb-bf23-81fc98b2511c", "tag": "fa31ad88-f4bc-44fb-9cce-f4956eec436b"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:08:14.682505 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:08:14.687215 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-6875173b-4208-4954-a898-cae7b7e79201 req-ddcd540b-f7ec-4009-bc3b-072d8b802b3e service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:14.687695 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-6875173b-4208-4954-a898-cae7b7e79201 req-ddcd540b-f7ec-4009-bc3b-072d8b802b3e service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:14.688128 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-6875173b-4208-4954-a898-cae7b7e79201 req-ddcd540b-f7ec-4009-bc3b-072d8b802b3e service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:14.692944 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:08:14.703057 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-6875173b-4208-4954-a898-cae7b7e79201 req-ddcd540b-f7ec-4009-bc3b-072d8b802b3e service nova] Creating event network-changed:fa31ad88-f4bc-44fb-9cce-f4956eec436b for instance 3aef86e9-856d-47fb-bf23-81fc98b2511c on hv-cinder-85987 Oct 03 15:08:14.709282 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-6875173b-4208-4954-a898-cae7b7e79201 req-ddcd540b-f7ec-4009-bc3b-072d8b802b3e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039655 Oct 03 15:08:14.710121 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 607/1180] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 15:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:08:15.797797 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-886ccb2b-ac87-4b56-adf0-d738ebd014e5 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1218009107"}} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:08:15.798395 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-886ccb2b-ac87-4b56-adf0-d738ebd014e5 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:15.806403 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-886ccb2b-ac87-4b56-adf0-d738ebd014e5 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:15.807249 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-886ccb2b-ac87-4b56-adf0-d738ebd014e5 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:15.807698 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-886ccb2b-ac87-4b56-adf0-d738ebd014e5 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:15.808399 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-886ccb2b-ac87-4b56-adf0-d738ebd014e5 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:15.809160 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-886ccb2b-ac87-4b56-adf0-d738ebd014e5 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:15.809544 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-886ccb2b-ac87-4b56-adf0-d738ebd014e5 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:15.952970 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.network.security_group_api [None req-886ccb2b-ac87-4b56-adf0-d738ebd014e5 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Adding security group bd0f620d-9f94-41af-9557-468f9295ab8a to port fa31ad88-f4bc-44fb-9cce-f4956eec436b Oct 03 15:08:16.262481 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-886ccb2b-ac87-4b56-adf0-d738ebd014e5 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "POST /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c/action" status: 202 len: 0 microversion: 2.1 time: 0.469506 Oct 03 15:08:16.263110 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 574/1181] 10.222.0.46 () {60 vars in 1278 bytes} [Mon Oct 3 15:08:15 2022] POST /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:08:16.272864 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-324a1f0f-861c-4ab6-a104-27dea67b94a2 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:16.273656 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-324a1f0f-861c-4ab6-a104-27dea67b94a2 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:16.282873 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-324a1f0f-861c-4ab6-a104-27dea67b94a2 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:16.283929 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-324a1f0f-861c-4ab6-a104-27dea67b94a2 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:16.284509 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-324a1f0f-861c-4ab6-a104-27dea67b94a2 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:16.285539 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-324a1f0f-861c-4ab6-a104-27dea67b94a2 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:16.286170 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-324a1f0f-861c-4ab6-a104-27dea67b94a2 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:16.287410 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-324a1f0f-861c-4ab6-a104-27dea67b94a2 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:16.440657 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-324a1f0f-861c-4ab6-a104-27dea67b94a2 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ee625591a14362a520aaad99db4ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:08:16.448953 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-324a1f0f-861c-4ab6-a104-27dea67b94a2 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 200 len: 1758 microversion: 2.1 time: 0.181296 Oct 03 15:08:16.449567 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 608/1182] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:16 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 1758 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:08:16.725324 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-12d8e9b8-45ec-4bc8-b33d-c3488c40bb5d req-8df87002-a24e-4f60-a5b0-79a00b53ce8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aef86e9-856d-47fb-bf23-81fc98b2511c", "tag": "fa31ad88-f4bc-44fb-9cce-f4956eec436b"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:08:16.735300 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-12d8e9b8-45ec-4bc8-b33d-c3488c40bb5d req-8df87002-a24e-4f60-a5b0-79a00b53ce8a service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:16.735785 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-12d8e9b8-45ec-4bc8-b33d-c3488c40bb5d req-8df87002-a24e-4f60-a5b0-79a00b53ce8a service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:16.736223 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-12d8e9b8-45ec-4bc8-b33d-c3488c40bb5d req-8df87002-a24e-4f60-a5b0-79a00b53ce8a service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:16.748375 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-12d8e9b8-45ec-4bc8-b33d-c3488c40bb5d req-8df87002-a24e-4f60-a5b0-79a00b53ce8a service nova] Creating event network-changed:fa31ad88-f4bc-44fb-9cce-f4956eec436b for instance 3aef86e9-856d-47fb-bf23-81fc98b2511c on hv-cinder-85987 Oct 03 15:08:16.755293 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-12d8e9b8-45ec-4bc8-b33d-c3488c40bb5d req-8df87002-a24e-4f60-a5b0-79a00b53ce8a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034601 Oct 03 15:08:16.756085 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 575/1183] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 15:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:09:16.921042 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_api:SELECT=3 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:09:16.921804 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=7 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:09:16.926135 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-f31801af-6c7b-4188-877c-a146472fd0c0 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:09:16.928337 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-f31801af-6c7b-4188-877c-a146472fd0c0 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:09:16.935941 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f31801af-6c7b-4188-877c-a146472fd0c0 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:16.936454 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f31801af-6c7b-4188-877c-a146472fd0c0 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:16.937003 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f31801af-6c7b-4188-877c-a146472fd0c0 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:16.937585 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f31801af-6c7b-4188-877c-a146472fd0c0 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:16.938125 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f31801af-6c7b-4188-877c-a146472fd0c0 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:16.938553 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-f31801af-6c7b-4188-877c-a146472fd0c0 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:17.006073 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-f31801af-6c7b-4188-877c-a146472fd0c0 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "POST /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c/action" status: 202 len: 0 microversion: 2.1 time: 0.086492 Oct 03 15:09:17.006708 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 609/1184] 10.222.0.46 () {60 vars in 1278 bytes} [Mon Oct 3 15:09:16 2022] POST /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:09:17.014457 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_api:SELECT=5 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:09:17.015229 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=11 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:09:17.019638 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-7b60cde2-ca62-4ff1-8845-8c0667aa239a tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:09:17.020873 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-7b60cde2-ca62-4ff1-8845-8c0667aa239a tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:09:17.028970 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7b60cde2-ca62-4ff1-8845-8c0667aa239a tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:17.029866 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7b60cde2-ca62-4ff1-8845-8c0667aa239a tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:17.030392 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7b60cde2-ca62-4ff1-8845-8c0667aa239a tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:17.031158 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7b60cde2-ca62-4ff1-8845-8c0667aa239a tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:17.031620 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7b60cde2-ca62-4ff1-8845-8c0667aa239a tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:17.032046 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-7b60cde2-ca62-4ff1-8845-8c0667aa239a tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:17.175619 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-7b60cde2-ca62-4ff1-8845-8c0667aa239a tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ee625591a14362a520aaad99db4ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:09:17.184805 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-7b60cde2-ca62-4ff1-8845-8c0667aa239a tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 200 len: 1750 microversion: 2.1 time: 0.172378 Oct 03 15:09:17.185600 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 576/1185] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:09:17 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 1750 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:09:18.208626 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-b0afa01c-846e-47eb-9af3-2f411d219ead tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:09:18.209326 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-b0afa01c-846e-47eb-9af3-2f411d219ead tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:09:18.215691 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b0afa01c-846e-47eb-9af3-2f411d219ead tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:18.216171 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b0afa01c-846e-47eb-9af3-2f411d219ead tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:18.216606 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b0afa01c-846e-47eb-9af3-2f411d219ead tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:18.217293 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b0afa01c-846e-47eb-9af3-2f411d219ead tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:18.217772 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b0afa01c-846e-47eb-9af3-2f411d219ead tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:18.218198 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b0afa01c-846e-47eb-9af3-2f411d219ead tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:18.362579 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-b0afa01c-846e-47eb-9af3-2f411d219ead tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ee625591a14362a520aaad99db4ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:09:18.371618 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-b0afa01c-846e-47eb-9af3-2f411d219ead tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 200 len: 1755 microversion: 2.1 time: 0.167136 Oct 03 15:09:18.372173 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 610/1186] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:09:18 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:09:19.394817 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-1ac30cf8-9660-4897-acdc-74715b99d612 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:09:19.395427 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-1ac30cf8-9660-4897-acdc-74715b99d612 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:09:19.402603 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1ac30cf8-9660-4897-acdc-74715b99d612 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:19.403091 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1ac30cf8-9660-4897-acdc-74715b99d612 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:19.403527 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1ac30cf8-9660-4897-acdc-74715b99d612 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:19.404215 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1ac30cf8-9660-4897-acdc-74715b99d612 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:19.404666 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1ac30cf8-9660-4897-acdc-74715b99d612 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:19.405089 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-1ac30cf8-9660-4897-acdc-74715b99d612 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:19.546855 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-1ac30cf8-9660-4897-acdc-74715b99d612 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ee625591a14362a520aaad99db4ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:09:19.555025 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-1ac30cf8-9660-4897-acdc-74715b99d612 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 200 len: 1755 microversion: 2.1 time: 0.164122 Oct 03 15:09:19.555591 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 577/1187] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:09:19 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:09:20.579902 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-eb8dec5f-3715-4586-8216-408c7d6eb966 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:09:20.580435 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-eb8dec5f-3715-4586-8216-408c7d6eb966 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:09:20.586722 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-eb8dec5f-3715-4586-8216-408c7d6eb966 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:20.587196 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-eb8dec5f-3715-4586-8216-408c7d6eb966 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:20.587622 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-eb8dec5f-3715-4586-8216-408c7d6eb966 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:20.588301 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-eb8dec5f-3715-4586-8216-408c7d6eb966 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:20.588743 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-eb8dec5f-3715-4586-8216-408c7d6eb966 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:20.589159 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-eb8dec5f-3715-4586-8216-408c7d6eb966 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:20.730554 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-eb8dec5f-3715-4586-8216-408c7d6eb966 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ee625591a14362a520aaad99db4ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:09:20.738649 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-eb8dec5f-3715-4586-8216-408c7d6eb966 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 200 len: 1755 microversion: 2.1 time: 0.162670 Oct 03 15:09:20.739210 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 611/1188] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:09:20 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:09:21.761443 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-361132f1-1c73-4802-a25f-1b9154b3a9b6 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:09:21.762083 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-361132f1-1c73-4802-a25f-1b9154b3a9b6 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:09:21.768475 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-361132f1-1c73-4802-a25f-1b9154b3a9b6 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:21.768961 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-361132f1-1c73-4802-a25f-1b9154b3a9b6 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:21.769591 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-361132f1-1c73-4802-a25f-1b9154b3a9b6 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:21.770804 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-361132f1-1c73-4802-a25f-1b9154b3a9b6 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:21.771614 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-361132f1-1c73-4802-a25f-1b9154b3a9b6 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:21.772363 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-361132f1-1c73-4802-a25f-1b9154b3a9b6 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:21.913963 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-361132f1-1c73-4802-a25f-1b9154b3a9b6 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ee625591a14362a520aaad99db4ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:09:21.922779 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-361132f1-1c73-4802-a25f-1b9154b3a9b6 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 200 len: 1755 microversion: 2.1 time: 0.165234 Oct 03 15:09:21.923353 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 578/1189] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:09:21 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:09:22.945116 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-66ce1e9b-acdf-4c3a-8eee-ad6ccbcec252 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:09:22.945741 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-66ce1e9b-acdf-4c3a-8eee-ad6ccbcec252 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:09:22.952154 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-66ce1e9b-acdf-4c3a-8eee-ad6ccbcec252 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:22.952642 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-66ce1e9b-acdf-4c3a-8eee-ad6ccbcec252 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:22.953078 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-66ce1e9b-acdf-4c3a-8eee-ad6ccbcec252 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:22.953796 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-66ce1e9b-acdf-4c3a-8eee-ad6ccbcec252 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:22.954253 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-66ce1e9b-acdf-4c3a-8eee-ad6ccbcec252 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:22.954682 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-66ce1e9b-acdf-4c3a-8eee-ad6ccbcec252 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:23.092850 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-66ce1e9b-acdf-4c3a-8eee-ad6ccbcec252 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ee625591a14362a520aaad99db4ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:09:23.100977 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-66ce1e9b-acdf-4c3a-8eee-ad6ccbcec252 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 200 len: 1755 microversion: 2.1 time: 0.159722 Oct 03 15:09:23.101562 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 612/1190] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:09:22 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:09:24.124465 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-e3ea938b-7028-47e0-b794-a085ab3de8d9 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:09:24.125061 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-e3ea938b-7028-47e0-b794-a085ab3de8d9 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:09:24.131459 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e3ea938b-7028-47e0-b794-a085ab3de8d9 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:24.131937 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e3ea938b-7028-47e0-b794-a085ab3de8d9 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:24.132370 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e3ea938b-7028-47e0-b794-a085ab3de8d9 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:24.133047 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e3ea938b-7028-47e0-b794-a085ab3de8d9 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:24.133515 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e3ea938b-7028-47e0-b794-a085ab3de8d9 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:24.133947 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-e3ea938b-7028-47e0-b794-a085ab3de8d9 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:24.275523 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-e3ea938b-7028-47e0-b794-a085ab3de8d9 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ee625591a14362a520aaad99db4ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:09:24.284420 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-e3ea938b-7028-47e0-b794-a085ab3de8d9 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 200 len: 1755 microversion: 2.1 time: 0.163483 Oct 03 15:09:24.284989 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 579/1191] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:09:24 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:09:25.308134 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-36b75889-2b31-48f0-83f0-87d446cdeb27 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:09:25.308746 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-36b75889-2b31-48f0-83f0-87d446cdeb27 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:09:25.316258 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-36b75889-2b31-48f0-83f0-87d446cdeb27 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:25.316741 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-36b75889-2b31-48f0-83f0-87d446cdeb27 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:25.317182 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-36b75889-2b31-48f0-83f0-87d446cdeb27 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:25.317913 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-36b75889-2b31-48f0-83f0-87d446cdeb27 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:25.318370 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-36b75889-2b31-48f0-83f0-87d446cdeb27 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:25.318814 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-36b75889-2b31-48f0-83f0-87d446cdeb27 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:25.459173 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-36b75889-2b31-48f0-83f0-87d446cdeb27 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ee625591a14362a520aaad99db4ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:09:25.468163 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-36b75889-2b31-48f0-83f0-87d446cdeb27 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 200 len: 1755 microversion: 2.1 time: 0.163858 Oct 03 15:09:25.468747 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 613/1192] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:09:25 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:09:26.491803 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-cb124537-270e-4be9-9466-2003d90a8cab tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:09:26.492325 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-cb124537-270e-4be9-9466-2003d90a8cab tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:09:26.495124 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 15:09:26.495281 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Mon Oct 3 15:09:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c (ip 10.222.0.46) !!! Oct 03 15:09:26.503958 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cb124537-270e-4be9-9466-2003d90a8cab tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:26.504443 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cb124537-270e-4be9-9466-2003d90a8cab tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:26.504877 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cb124537-270e-4be9-9466-2003d90a8cab tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:26.505605 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cb124537-270e-4be9-9466-2003d90a8cab tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:26.506199 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cb124537-270e-4be9-9466-2003d90a8cab tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:26.506628 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-cb124537-270e-4be9-9466-2003d90a8cab tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:26.877470 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-cb124537-270e-4be9-9466-2003d90a8cab tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ee625591a14362a520aaad99db4ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:09:26.885740 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-cb124537-270e-4be9-9466-2003d90a8cab tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 200 len: 1755 microversion: 2.1 time: 0.397828 Oct 03 15:09:26.886311 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 580/1193] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:09:26 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 1755 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:09:27.908712 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-afc7fa30-b191-4ebd-bb19-aefdf1a8cf1c tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:09:27.909315 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-afc7fa30-b191-4ebd-bb19-aefdf1a8cf1c tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:09:27.915874 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-afc7fa30-b191-4ebd-bb19-aefdf1a8cf1c tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:27.916348 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-afc7fa30-b191-4ebd-bb19-aefdf1a8cf1c tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:27.916779 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-afc7fa30-b191-4ebd-bb19-aefdf1a8cf1c tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:27.917467 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-afc7fa30-b191-4ebd-bb19-aefdf1a8cf1c tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:27.917943 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-afc7fa30-b191-4ebd-bb19-aefdf1a8cf1c tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:27.918412 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-afc7fa30-b191-4ebd-bb19-aefdf1a8cf1c tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:28.056699 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-afc7fa30-b191-4ebd-bb19-aefdf1a8cf1c tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ee625591a14362a520aaad99db4ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:09:28.066704 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-afc7fa30-b191-4ebd-bb19-aefdf1a8cf1c tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 200 len: 1755 microversion: 2.1 time: 0.161885 Oct 03 15:09:28.067266 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 614/1194] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:09:27 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:09:29.089792 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-abe17e70-5710-45a6-b798-8913f9e2fe84 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:09:29.091276 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-abe17e70-5710-45a6-b798-8913f9e2fe84 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:09:29.097743 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-abe17e70-5710-45a6-b798-8913f9e2fe84 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:29.098235 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-abe17e70-5710-45a6-b798-8913f9e2fe84 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:29.098670 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-abe17e70-5710-45a6-b798-8913f9e2fe84 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:29.099361 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-abe17e70-5710-45a6-b798-8913f9e2fe84 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:29.099815 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-abe17e70-5710-45a6-b798-8913f9e2fe84 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:29.100240 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-abe17e70-5710-45a6-b798-8913f9e2fe84 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:29.240690 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-abe17e70-5710-45a6-b798-8913f9e2fe84 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ee625591a14362a520aaad99db4ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:09:29.249303 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-abe17e70-5710-45a6-b798-8913f9e2fe84 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 200 len: 1758 microversion: 2.1 time: 0.163472 Oct 03 15:09:29.249911 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 581/1195] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:09:29 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:10:32.545945 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_api:SELECT=12 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:10:32.546630 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG dbcounter [-] [126851] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:10:32.550937 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-4a9a5051-5291-4669-987a-c782a4861de9 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1218009107"}} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:10:32.551464 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-4a9a5051-5291-4669-987a-c782a4861de9 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:10:32.559245 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4a9a5051-5291-4669-987a-c782a4861de9 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:32.559728 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4a9a5051-5291-4669-987a-c782a4861de9 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:32.560154 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4a9a5051-5291-4669-987a-c782a4861de9 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:32.560838 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4a9a5051-5291-4669-987a-c782a4861de9 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:32.561287 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4a9a5051-5291-4669-987a-c782a4861de9 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:32.561752 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4a9a5051-5291-4669-987a-c782a4861de9 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:32.689137 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.network.security_group_api [None req-4a9a5051-5291-4669-987a-c782a4861de9 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Removing security group bd0f620d-9f94-41af-9557-468f9295ab8a from port fa31ad88-f4bc-44fb-9cce-f4956eec436b Oct 03 15:10:32.978008 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-4a9a5051-5291-4669-987a-c782a4861de9 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "POST /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c/action" status: 202 len: 0 microversion: 2.1 time: 0.433757 Oct 03 15:10:32.978677 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 615/1196] 10.222.0.46 () {60 vars in 1278 bytes} [Mon Oct 3 15:10:32 2022] POST /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c/action => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:10:32.988515 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_api:SELECT=12 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:10:32.989741 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG dbcounter [-] [126852] Writing DB stats nova_cell1:SELECT=36 {{(pid=126852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:10:33.111431 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-0221fa6b-72e4-49c2-b136-4d01c7761775 req-9d38a279-3fb0-455b-97c6-5e1f0eded60a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aef86e9-856d-47fb-bf23-81fc98b2511c", "tag": "fa31ad88-f4bc-44fb-9cce-f4956eec436b"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:10:33.121692 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-0221fa6b-72e4-49c2-b136-4d01c7761775 req-9d38a279-3fb0-455b-97c6-5e1f0eded60a service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:33.122255 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-0221fa6b-72e4-49c2-b136-4d01c7761775 req-9d38a279-3fb0-455b-97c6-5e1f0eded60a service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:33.122918 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-0221fa6b-72e4-49c2-b136-4d01c7761775 req-9d38a279-3fb0-455b-97c6-5e1f0eded60a service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:33.136307 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-0221fa6b-72e4-49c2-b136-4d01c7761775 req-9d38a279-3fb0-455b-97c6-5e1f0eded60a service nova] Creating event network-changed:fa31ad88-f4bc-44fb-9cce-f4956eec436b for instance 3aef86e9-856d-47fb-bf23-81fc98b2511c on hv-cinder-85987 Oct 03 15:10:33.140239 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR oslo.messaging._drivers.impl_rabbit [req-0221fa6b-72e4-49c2-b136-4d01c7761775 req-9d38a279-3fb0-455b-97c6-5e1f0eded60a service nova] [2ffc55dd-d7b7-4dca-8bbe-9523ed1d09f4] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 15:10:34.147900 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO oslo.messaging._drivers.impl_rabbit [req-0221fa6b-72e4-49c2-b136-4d01c7761775 req-9d38a279-3fb0-455b-97c6-5e1f0eded60a service nova] [2ffc55dd-d7b7-4dca-8bbe-9523ed1d09f4] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 45716. Oct 03 15:10:34.152370 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-0221fa6b-72e4-49c2-b136-4d01c7761775 req-9d38a279-3fb0-455b-97c6-5e1f0eded60a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.169797 Oct 03 15:10:34.153011 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 582/1197] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 15:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:10:34.267661 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-a42fc09f-08ee-437e-bcc4-856dde36df02 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:10:34.268147 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-a42fc09f-08ee-437e-bcc4-856dde36df02 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:10:34.274128 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a42fc09f-08ee-437e-bcc4-856dde36df02 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:34.274600 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a42fc09f-08ee-437e-bcc4-856dde36df02 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:34.275124 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a42fc09f-08ee-437e-bcc4-856dde36df02 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:34.275707 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a42fc09f-08ee-437e-bcc4-856dde36df02 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:34.276916 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a42fc09f-08ee-437e-bcc4-856dde36df02 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:34.277340 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-a42fc09f-08ee-437e-bcc4-856dde36df02 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:34.363353 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.objects.instance [None req-a42fc09f-08ee-437e-bcc4-856dde36df02 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lazy-loading 'services' on Instance uuid 3aef86e9-856d-47fb-bf23-81fc98b2511c {{(pid=126851) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:10:34.440061 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-a42fc09f-08ee-437e-bcc4-856dde36df02 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c/os-volume_attachments/52445fed-abd7-4e35-9861-4c834b9514bd" status: 202 len: 0 microversion: 2.1 time: 0.176656 Oct 03 15:10:34.440936 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 616/1198] 10.222.0.46 () {58 vars in 1416 bytes} [Mon Oct 3 15:10:34 2022] DELETE /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c/os-volume_attachments/52445fed-abd7-4e35-9861-4c834b9514bd => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:10:34.453000 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-8ee19263-3bba-4923-bb6f-80b5d92aba5c tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:10:34.456406 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-8ee19263-3bba-4923-bb6f-80b5d92aba5c tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:10:34.464438 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8ee19263-3bba-4923-bb6f-80b5d92aba5c tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:34.465314 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8ee19263-3bba-4923-bb6f-80b5d92aba5c tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:34.466110 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8ee19263-3bba-4923-bb6f-80b5d92aba5c tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:34.466901 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8ee19263-3bba-4923-bb6f-80b5d92aba5c tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:34.467440 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8ee19263-3bba-4923-bb6f-80b5d92aba5c tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:34.467943 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-8ee19263-3bba-4923-bb6f-80b5d92aba5c tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:34.499377 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-8ee19263-3bba-4923-bb6f-80b5d92aba5c tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053680 Oct 03 15:10:34.499948 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 583/1199] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 3 15:10:34 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:10:35.512685 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-4aff4923-8e7c-453c-b056-ef0983913bb1 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:10:35.515002 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-4aff4923-8e7c-453c-b056-ef0983913bb1 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:10:35.521034 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4aff4923-8e7c-453c-b056-ef0983913bb1 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:35.521548 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4aff4923-8e7c-453c-b056-ef0983913bb1 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:35.522012 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4aff4923-8e7c-453c-b056-ef0983913bb1 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:35.522683 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4aff4923-8e7c-453c-b056-ef0983913bb1 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:35.523141 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4aff4923-8e7c-453c-b056-ef0983913bb1 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:35.523565 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-4aff4923-8e7c-453c-b056-ef0983913bb1 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:35.552034 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-4aff4923-8e7c-453c-b056-ef0983913bb1 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044228 Oct 03 15:10:35.552577 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 617/1200] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 3 15:10:35 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 15:10:35.563146 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-d5c3aa16-00ef-40a2-85b5-405dae9730a4 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:10:35.563654 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-d5c3aa16-00ef-40a2-85b5-405dae9730a4 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:10:35.569976 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d5c3aa16-00ef-40a2-85b5-405dae9730a4 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:35.570453 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d5c3aa16-00ef-40a2-85b5-405dae9730a4 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:35.570883 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d5c3aa16-00ef-40a2-85b5-405dae9730a4 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:35.571562 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d5c3aa16-00ef-40a2-85b5-405dae9730a4 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:35.572015 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d5c3aa16-00ef-40a2-85b5-405dae9730a4 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:35.572432 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-d5c3aa16-00ef-40a2-85b5-405dae9730a4 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:35.645568 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.wsgi [None req-d5c3aa16-00ef-40a2-85b5-405dae9730a4 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] HTTP exception thrown: Instance 3aef86e9-856d-47fb-bf23-81fc98b2511c is not attached to volume 52445fed-abd7-4e35-9861-4c834b9514bd Oct 03 15:10:35.647923 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-d5c3aa16-00ef-40a2-85b5-405dae9730a4 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Request method failure captured: Oct 03 15:10:35.647923 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: request: DELETE /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c/os-volume_attachments/52445fed-abd7-4e35-9861-4c834b9514bd HTTP/1.1 Oct 03 15:10:35.647923 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept: application/json Oct 03 15:10:35.647923 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Accept-Encoding: identity Oct 03 15:10:35.647923 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Connection: close Oct 03 15:10:35.647923 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Length: 0 Oct 03 15:10:35.647923 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Content-Type: application/json Oct 03 15:10:35.647923 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Host: 10.222.0.46 Oct 03 15:10:35.647923 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: Openstack-System-Scope: None Oct 03 15:10:35.647923 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: User-Agent: python-urllib3/1.26.12 Oct 03 15:10:35.647923 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Auth-Token: gAAAAABjOvquhuyOW3--JYmT04QbcRUB4DdH877EZ5KqHbOqZB7XpfSAMykMvwx0GVwNnxTMC33eqX-Z89340bhFWwl_YlBznowuC92lk0oE9G5PJeGNFUKFydP2ZmGB2skbM6RJyJWE8LUSg8JwVTE2x7DVnM1OJFT30fIJuvxM9QcBu4JUo8g Oct 03 15:10:35.647923 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Id: None Oct 03 15:10:35.647923 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Domain-Name: None Oct 03 15:10:35.647923 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Identity-Status: Confirmed Oct 03 15:10:35.647923 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Is-Admin-Project: True Oct 03 15:10:35.647923 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Id: default Oct 03 15:10:35.647923 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Domain-Name: Default Oct 03 15:10:35.647923 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Id: 1b1db654fb9f4320ade1ca90e5000e09 Oct 03 15:10:35.647923 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Project-Name: tempest-TestMinimumBasicScenario-1222944520 Oct 03 15:10:35.647923 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Role: member,reader Oct 03 15:10:35.647923 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Roles: member,reader Oct 03 15:10:35.649604 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1b1db654fb9f4320ade1ca90e5000e09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_1b1db654fb9f4320ade1ca90e5000e09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1b1db654fb9f4320ade1ca90e5000e09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/1b1db654fb9f4320ade1ca90e5000e09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 15:10:35.649604 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant: tempest-TestMinimumBasicScenario-1222944520 Oct 03 15:10:35.649604 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Id: 1b1db654fb9f4320ade1ca90e5000e09 Oct 03 15:10:35.649604 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1222944520 Oct 03 15:10:35.649604 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User: tempest-TestMinimumBasicScenario-1222944520-project Oct 03 15:10:35.649604 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Id: default Oct 03 15:10:35.649604 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Domain-Name: Default Oct 03 15:10:35.649604 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Id: 12ee625591a14362a520aaad99db4ba8 Oct 03 15:10:35.649604 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: X-User-Name: tempest-TestMinimumBasicScenario-1222944520-project Oct 03 15:10:35.649604 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: method: > Oct 03 15:10:35.649604 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: exception: Instance 3aef86e9-856d-47fb-bf23-81fc98b2511c is not attached to volume 52445fed-abd7-4e35-9861-4c834b9514bd Oct 03 15:10:35.650686 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: action_args: {'server_id': '3aef86e9-856d-47fb-bf23-81fc98b2511c', 'id': '52445fed-abd7-4e35-9861-4c834b9514bd'} Oct 03 15:10:35.650686 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:10:35.650686 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:10:35.650686 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 03 15:10:35.650686 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 03 15:10:35.650686 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 15:10:35.650686 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 15:10:35.650686 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 03 15:10:35.650686 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 03 15:10:35.650686 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 52445fed-abd7-4e35-9861-4c834b9514bd. Oct 03 15:10:35.650686 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:10:35.650686 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:10:35.650686 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:10:35.650686 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:10:35.650686 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:10:35.650686 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:10:35.650686 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:10:35.650686 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:10:35.650686 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:10:35.652888 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:10:35.652888 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 03 15:10:35.652888 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 03 15:10:35.652888 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aef86e9-856d-47fb-bf23-81fc98b2511c is not attached to volume 52445fed-abd7-4e35-9861-4c834b9514bd Oct 03 15:10:35.652888 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:10:35.652888 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:10:35.652888 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:10:35.652888 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:10:35.652888 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:10:35.652888 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:10:35.652888 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:10:35.652888 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:10:35.652888 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aef86e9-856d-47fb-bf23-81fc98b2511c is not attached to volume 52445fed-abd7-4e35-9861-4c834b9514bd Oct 03 15:10:35.652888 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: ERROR nova.api.openstack.wsgi Oct 03 15:10:35.652888 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-d5c3aa16-00ef-40a2-85b5-405dae9730a4 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Returning 404 to user: Instance 3aef86e9-856d-47fb-bf23-81fc98b2511c is not attached to volume 52445fed-abd7-4e35-9861-4c834b9514bd {{(pid=126852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:10:35.654261 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-d5c3aa16-00ef-40a2-85b5-405dae9730a4 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c/os-volume_attachments/52445fed-abd7-4e35-9861-4c834b9514bd" status: 404 len: 154 microversion: 2.1 time: 0.090169 Oct 03 15:10:35.654261 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 584/1201] 10.222.0.46 () {58 vars in 1416 bytes} [Mon Oct 3 15:10:35 2022] DELETE /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c/os-volume_attachments/52445fed-abd7-4e35-9861-4c834b9514bd => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:10:36.189480 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [req-5052cece-8aac-4d11-baa1-fd952c008bff req-9ea9fbf1-3205-40b5-a769-e0a167c4e8b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aef86e9-856d-47fb-bf23-81fc98b2511c", "tag": "fa31ad88-f4bc-44fb-9cce-f4956eec436b"}]} {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:10:36.198659 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-5052cece-8aac-4d11-baa1-fd952c008bff req-9ea9fbf1-3205-40b5-a769-e0a167c4e8b7 service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:36.199785 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-5052cece-8aac-4d11-baa1-fd952c008bff req-9ea9fbf1-3205-40b5-a769-e0a167c4e8b7 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:36.200217 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [req-5052cece-8aac-4d11-baa1-fd952c008bff req-9ea9fbf1-3205-40b5-a769-e0a167c4e8b7 service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:36.210840 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.compute.server_external_events [req-5052cece-8aac-4d11-baa1-fd952c008bff req-9ea9fbf1-3205-40b5-a769-e0a167c4e8b7 service nova] Creating event network-changed:fa31ad88-f4bc-44fb-9cce-f4956eec436b for instance 3aef86e9-856d-47fb-bf23-81fc98b2511c on hv-cinder-85987 Oct 03 15:10:36.215936 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [req-5052cece-8aac-4d11-baa1-fd952c008bff req-9ea9fbf1-3205-40b5-a769-e0a167c4e8b7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029954 Oct 03 15:10:36.216496 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 618/1202] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 15:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:10:36.787788 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-457c1ea9-acd4-4269-89c0-09c10bfc5231 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:10:36.788297 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-457c1ea9-acd4-4269-89c0-09c10bfc5231 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:10:36.795316 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-457c1ea9-acd4-4269-89c0-09c10bfc5231 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:36.795796 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-457c1ea9-acd4-4269-89c0-09c10bfc5231 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:36.796231 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-457c1ea9-acd4-4269-89c0-09c10bfc5231 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:36.796920 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-457c1ea9-acd4-4269-89c0-09c10bfc5231 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:36.797379 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-457c1ea9-acd4-4269-89c0-09c10bfc5231 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:36.797828 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-457c1ea9-acd4-4269-89c0-09c10bfc5231 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:36.821992 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-457c1ea9-acd4-4269-89c0-09c10bfc5231 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Going to try to terminate instance {{(pid=126852) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:10:36.895819 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-457c1ea9-acd4-4269-89c0-09c10bfc5231 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 204 len: 0 microversion: 2.1 time: 0.111526 Oct 03 15:10:36.896543 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 585/1203] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 3 15:10:36 2022] DELETE /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:10:36.906335 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-d029dba1-2adf-4c83-95b0-7cddea22aa0c tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:10:36.907034 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-d029dba1-2adf-4c83-95b0-7cddea22aa0c tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:10:36.913004 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d029dba1-2adf-4c83-95b0-7cddea22aa0c tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:36.913483 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d029dba1-2adf-4c83-95b0-7cddea22aa0c tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:36.913947 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d029dba1-2adf-4c83-95b0-7cddea22aa0c tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:36.914635 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d029dba1-2adf-4c83-95b0-7cddea22aa0c tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:36.915089 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d029dba1-2adf-4c83-95b0-7cddea22aa0c tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:36.915511 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-d029dba1-2adf-4c83-95b0-7cddea22aa0c tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:37.043337 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-d029dba1-2adf-4c83-95b0-7cddea22aa0c tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ee625591a14362a520aaad99db4ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:10:37.050911 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-d029dba1-2adf-4c83-95b0-7cddea22aa0c tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 200 len: 1553 microversion: 2.1 time: 0.149738 Oct 03 15:10:37.051471 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 619/1204] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:10:36 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:10:38.074553 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-f2b9a625-10ec-4732-bb77-118e36c701f7 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:10:38.075246 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.compute.api [None req-f2b9a625-10ec-4732-bb77-118e36c701f7 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126852) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:10:38.081531 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f2b9a625-10ec-4732-bb77-118e36c701f7 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:38.082009 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f2b9a625-10ec-4732-bb77-118e36c701f7 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:38.082441 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f2b9a625-10ec-4732-bb77-118e36c701f7 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:38.083121 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f2b9a625-10ec-4732-bb77-118e36c701f7 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:38.083575 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f2b9a625-10ec-4732-bb77-118e36c701f7 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:38.083991 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [None req-f2b9a625-10ec-4732-bb77-118e36c701f7 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:38.214960 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.policy [None req-f2b9a625-10ec-4732-bb77-118e36c701f7 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ee625591a14362a520aaad99db4ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126852) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:10:38.222853 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-f2b9a625-10ec-4732-bb77-118e36c701f7 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 200 len: 1553 microversion: 2.1 time: 0.152683 Oct 03 15:10:38.223411 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 586/1205] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:10:38 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:10:39.246727 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-35fa3b79-ffa5-4c71-832a-1a624482cd19 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:10:39.247334 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-35fa3b79-ffa5-4c71-832a-1a624482cd19 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:10:39.253959 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-35fa3b79-ffa5-4c71-832a-1a624482cd19 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:39.254445 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-35fa3b79-ffa5-4c71-832a-1a624482cd19 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:39.254880 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-35fa3b79-ffa5-4c71-832a-1a624482cd19 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:39.255603 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-35fa3b79-ffa5-4c71-832a-1a624482cd19 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:39.256858 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-35fa3b79-ffa5-4c71-832a-1a624482cd19 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:39.256858 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-35fa3b79-ffa5-4c71-832a-1a624482cd19 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:39.337833 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [req-10b5b7e9-f68c-4683-8e62-ca9f105cb1b0 req-2f0a813d-2237-4165-a6f0-4786831df00e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aef86e9-856d-47fb-bf23-81fc98b2511c", "name": "network-vif-deleted", "tag": "fa31ad88-f4bc-44fb-9cce-f4956eec436b"}]} {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:10:39.349624 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-10b5b7e9-f68c-4683-8e62-ca9f105cb1b0 req-2f0a813d-2237-4165-a6f0-4786831df00e service nova] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:39.350017 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-10b5b7e9-f68c-4683-8e62-ca9f105cb1b0 req-2f0a813d-2237-4165-a6f0-4786831df00e service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:39.350442 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG oslo_concurrency.lockutils [req-10b5b7e9-f68c-4683-8e62-ca9f105cb1b0 req-2f0a813d-2237-4165-a6f0-4786831df00e service nova] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:39.351971 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.policy [None req-35fa3b79-ffa5-4c71-832a-1a624482cd19 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12ee625591a14362a520aaad99db4ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1db654fb9f4320ade1ca90e5000e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126851) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:10:39.361930 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-35fa3b79-ffa5-4c71-832a-1a624482cd19 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 200 len: 1511 microversion: 2.1 time: 0.119421 Oct 03 15:10:39.376128 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 620/1206] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:10:39 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 1511 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:10:39.376993 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.compute.server_external_events [req-10b5b7e9-f68c-4683-8e62-ca9f105cb1b0 req-2f0a813d-2237-4165-a6f0-4786831df00e service nova] Creating event network-vif-deleted:fa31ad88-f4bc-44fb-9cce-f4956eec436b for instance 3aef86e9-856d-47fb-bf23-81fc98b2511c on hv-cinder-85987 Oct 03 15:10:39.376993 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [req-10b5b7e9-f68c-4683-8e62-ca9f105cb1b0 req-2f0a813d-2237-4165-a6f0-4786831df00e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035625 Oct 03 15:10:39.376993 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 587/1207] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 3 15:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:10:40.385725 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-b85f2d54-7df3-4886-bba8-14c9d903340f tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '>' {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:10:40.386945 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.compute.api [None req-b85f2d54-7df3-4886-bba8-14c9d903340f tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] [instance: 3aef86e9-856d-47fb-bf23-81fc98b2511c] Fetching instance by UUID {{(pid=126851) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:10:40.393041 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b85f2d54-7df3-4886-bba8-14c9d903340f tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:40.393560 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b85f2d54-7df3-4886-bba8-14c9d903340f tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:40.394017 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b85f2d54-7df3-4886-bba8-14c9d903340f tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:40.394715 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b85f2d54-7df3-4886-bba8-14c9d903340f tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Acquiring lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:40.395142 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b85f2d54-7df3-4886-bba8-14c9d903340f tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:40.395560 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG oslo_concurrency.lockutils [None req-b85f2d54-7df3-4886-bba8-14c9d903340f tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Lock "be5c6f43-0ff9-4454-a14a-9cca214f362b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:40.408462 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.wsgi [None req-b85f2d54-7df3-4886-bba8-14c9d903340f tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] HTTP exception thrown: Instance 3aef86e9-856d-47fb-bf23-81fc98b2511c could not be found. Oct 03 15:10:40.410085 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-b85f2d54-7df3-4886-bba8-14c9d903340f tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Request method failure captured: Oct 03 15:10:40.410085 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: request: GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c HTTP/1.1 Oct 03 15:10:40.410085 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept: application/json Oct 03 15:10:40.410085 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Accept-Encoding: identity Oct 03 15:10:40.410085 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Connection: close Oct 03 15:10:40.410085 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Length: 0 Oct 03 15:10:40.410085 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Content-Type: application/json Oct 03 15:10:40.410085 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Host: 10.222.0.46 Oct 03 15:10:40.410085 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: Openstack-System-Scope: None Oct 03 15:10:40.410085 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: User-Agent: python-urllib3/1.26.12 Oct 03 15:10:40.410085 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Auth-Token: gAAAAABjOvquhuyOW3--JYmT04QbcRUB4DdH877EZ5KqHbOqZB7XpfSAMykMvwx0GVwNnxTMC33eqX-Z89340bhFWwl_YlBznowuC92lk0oE9G5PJeGNFUKFydP2ZmGB2skbM6RJyJWE8LUSg8JwVTE2x7DVnM1OJFT30fIJuvxM9QcBu4JUo8g Oct 03 15:10:40.410085 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Id: None Oct 03 15:10:40.410085 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Domain-Name: None Oct 03 15:10:40.410085 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Identity-Status: Confirmed Oct 03 15:10:40.410085 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Is-Admin-Project: True Oct 03 15:10:40.410085 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Id: default Oct 03 15:10:40.410085 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Domain-Name: Default Oct 03 15:10:40.410085 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Id: 1b1db654fb9f4320ade1ca90e5000e09 Oct 03 15:10:40.410085 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Project-Name: tempest-TestMinimumBasicScenario-1222944520 Oct 03 15:10:40.410085 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Role: member,reader Oct 03 15:10:40.410085 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Roles: member,reader Oct 03 15:10:40.411825 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1b1db654fb9f4320ade1ca90e5000e09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_1b1db654fb9f4320ade1ca90e5000e09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1b1db654fb9f4320ade1ca90e5000e09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/1b1db654fb9f4320ade1ca90e5000e09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}] Oct 03 15:10:40.411825 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant: tempest-TestMinimumBasicScenario-1222944520 Oct 03 15:10:40.411825 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Id: 1b1db654fb9f4320ade1ca90e5000e09 Oct 03 15:10:40.411825 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1222944520 Oct 03 15:10:40.411825 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User: tempest-TestMinimumBasicScenario-1222944520-project Oct 03 15:10:40.411825 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Id: default Oct 03 15:10:40.411825 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Domain-Name: Default Oct 03 15:10:40.411825 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Id: 12ee625591a14362a520aaad99db4ba8 Oct 03 15:10:40.411825 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: X-User-Name: tempest-TestMinimumBasicScenario-1222944520-project Oct 03 15:10:40.411825 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: method: > Oct 03 15:10:40.411825 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: exception: Instance 3aef86e9-856d-47fb-bf23-81fc98b2511c could not be found. Oct 03 15:10:40.411825 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: action_args: {'id': '3aef86e9-856d-47fb-bf23-81fc98b2511c'} Oct 03 15:10:40.412849 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: {{(pid=126851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:10:40.412849 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:10:40.412849 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:10:40.412849 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:10:40.412849 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:10:40.412849 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:10:40.412849 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:10:40.412849 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:10:40.412849 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:10:40.412849 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:10:40.412849 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aef86e9-856d-47fb-bf23-81fc98b2511c could not be found. Oct 03 15:10:40.412849 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:10:40.412849 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:10:40.412849 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:10:40.412849 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:10:40.412849 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:10:40.412849 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:10:40.412849 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:10:40.412849 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:10:40.412849 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:10:40.414523 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:10:40.414523 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:10:40.414523 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:10:40.414523 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:10:40.414523 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:10:40.414523 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:10:40.414523 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:10:40.414523 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aef86e9-856d-47fb-bf23-81fc98b2511c could not be found. Oct 03 15:10:40.414523 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:10:40.414523 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:10:40.414523 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:10:40.414523 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:10:40.414523 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:10:40.414523 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:10:40.414523 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:10:40.414523 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:10:40.414523 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aef86e9-856d-47fb-bf23-81fc98b2511c could not be found. Oct 03 15:10:40.414523 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: ERROR nova.api.openstack.wsgi Oct 03 15:10:40.416048 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: DEBUG nova.api.openstack.wsgi [None req-b85f2d54-7df3-4886-bba8-14c9d903340f tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Returning 404 to user: Instance 3aef86e9-856d-47fb-bf23-81fc98b2511c could not be found. {{(pid=126851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:10:40.416048 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: INFO nova.api.openstack.requestlog [None req-b85f2d54-7df3-4886-bba8-14c9d903340f tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c" status: 404 len: 111 microversion: 2.1 time: 0.029720 Oct 03 15:10:40.416048 dv-cinder-859877-2-iscsi devstack@n-api.service[126851]: [pid: 126851|app: 0|req: 621/1208] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 3 15:10:40 2022] GET /compute/v2.1/servers/3aef86e9-856d-47fb-bf23-81fc98b2511c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:10:40.420768 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: DEBUG nova.api.openstack.wsgi [None req-6794c27c-bf32-4a67-a0d4-728c9d9c0c56 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] Calling method '.version_select at 0x7fe0d33c7160>' {{(pid=126852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:10:40.442319 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: INFO nova.api.openstack.requestlog [None req-6794c27c-bf32-4a67-a0d4-728c9d9c0c56 tempest-TestMinimumBasicScenario-1222944520 tempest-TestMinimumBasicScenario-1222944520-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-77994264" status: 202 len: 0 microversion: 2.1 time: 0.026028 Oct 03 15:10:40.442866 dv-cinder-859877-2-iscsi devstack@n-api.service[126852]: [pid: 126852|app: 0|req: 588/1209] 10.222.0.46 () {58 vars in 1266 bytes} [Mon Oct 3 15:10:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-77994264 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)